DOCUMENT RESUME 



ED 340 126 



EA 023 553 



SPONS AGENCY 
PUB DATE 
NOTE 

PUB TYPE 



AUTHOR 
TITLE 



INSTITUTION 



Vandegrift, Judith A.; And Others 

Powerful Stories^ Positive Results: Arizona At-Risk 

Policy Report, FY 1990-91 Executive Summary . 

Arizona State Univ., Tempe. Morrison Inst, for Public 

Policy* 

Arizona State Dept. of Education.- Phoenix. 
15 Nov 91 

39p.? For the Project Report, see EA 023 547. 
Reports - Evaluative/Feasibility (142) 



EDRS PRICE 
DESCRIPTORS 



MF01/PC02 Plus Postage. 



Academic Achievement; ^Educationally Disadvantaged; 
Elementary Secondary Education; *High Risk Students; 
^Intervention; ^Potential Dropouts; *State Programs; 
Student Attrition 



IDENTIFIERS 



^Arizona 



ABSTRACT 



Outcomes of educational programs for at-risk youth in 



Arizona are described in this report for the fiscal year 1990-91. 
Based on 3 years of experience and data from 55 districts and schools 
with at-risk programs, the report determines the impact of various 
strategies, presents holistic and discrete intervention models, and 
discusses policy issues and options. Described are program 
characteristics, at-risk variables, and effective strategies for K-3 
and 7-12 students. Outcomes in student achievement, parental 
involvement, and staff training are also presented. Other findings 
are discussed, such as factors in the quality of implementation and 
the state role. Eleven recommendations are offered. Ten tables and 
one figure are included. (16 references) (LMI) 



* Reproductions supplied EDRS are the best that can be made * 



* 



from thki original document. 



•k 



ERIC 



POWERFUL STORIES.I 
POSITIVE RESULTS 

Arizona At-Rlsk 
Policy Report 



US OCPARTMiNTOFeDUCATK>N 

ZnONAL »fSOuRCkS INFORMATION 
. f}o( uHiortl has t>«en repfOdllC^d 

I " Miii(»i riMny»>h havtf l>^et« mad* lo imprOv* 



"«p»»t (i<i n(M »»!»sa'iiv ippf»*^ni official 



"PERMISSION TO REPRODUCE THIS 
MATEhiAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



BEST COPY AVAILABIE 



POWERFUL STORIES, 
POSITIVE RESULTS 

Arizona At-Risk 
Policy Report 



FY 1990-91 



Prepared for: 
C. Diane Bishop 
State Superintendent of Public Instruction 
Arizona Department of Education 

For Submission to: 
Arizona State Legislature 

November 15, 1991 



ERiC 



o 



POWERFUL STORIES, POSITIVE RESULTS 



ARIZONA AT-RISK POLICY REPORT 
FY 1990-91 



by 

Judith A. Vandegrift, Ph.D. 
At-Risk Research Director 

and 

Louann Bierlein, Ed.D. 
Andrea Greene, M.A. 



Prepared by 

Morrison Institute for Public Policy 
School of Public Affairs 
Arizona State University 



ERIC 



t 



70 Years Ago and Today 



•...Tl» evolution of our locuil order baa been 
proceeding whh greet and eve^aocclerating rapidity* 
Simple conditionahave been growing oomplex. Small 
inatitutsoni have been growing large. Increaied 
specialization hai been multiplying human intcrdepen* 
denciea and the consequent need of coordinating 
effort., o 

*Aa the world presses eagerly forward toward 
the accomplishment of new things, education must 
advance no less swiftly.... 

"New duties lie before us. A^id diese rsquire 
«tew methods* new materials, new vision... Bducation 
is now to develop a type of wisdom *hat can grow 
only out of psiticipation in the living experiences of 
men... (It must] train thought aud judgment in con- 
nection with actual life-situations... It is also to 
develop the good-will, the spirit of service, the social 
valuations, sympathies, and attitudes of mind necea^ 
sary for effective group-action where specialization 
has created endlesa interdependency. It has the 
function of training every citizen, man or woman^ run 
for knowledge about citizenship, but for pnJSciency in 
dtizetuhip^ noi for knowledge about hygiene, but for 
proficiency in maintaining rolmst health; not for mere 
knowledge of abstnct science, but for proficiency in 
the use of new ideas in the control qf practical 
situations. (We need to develop] the power to think 
snd feel and will and act in vital relation to the 
world'a life...." 

- Franklin Bobbiu 
Professor of Educational Administration 
The University of Chicago 

Copyright, 1918 



Reading Professor Bobbin's charge to education, 
it is difficult to ignore the parallel between the "state 
of the Nation** 70 years ago and today; or that our 
educational expectations remain essentially un- 
changed. What has changed is the fundamental 
composition of society. 

As most people today are aware, there have been 
"spectacular changes that have occurred in the nature 
of the children who come to school" with "about one- 
third of preschool children destined for school failure 
because of poverty, neglect, sickness, handicapping 
conditions, and lack of adult protection and nurtur- 
ance" (Hodgkinson, 1991). The phrase "at-risk" has 
been coined to describe those students whose school 



success is threatened by these types of environmental 
conditions. 

Many of these conditions are not new, nor is 
failure in school. What is new is the magnitude of the 
numbers and the con ^uences of dropping out of 
school in today's society. In the past, opportunities 
existed for yoimg people who dropped out of school 
to become highly productive citizens. This is no 
longer the case. It is predicted that the "failure to 
anticipate., .changes in the composition of the student 
population and to plan appropriate responses will 
leave us not with the same educational problems we 
face today » but perhaps with problems so severe and 
widespread as to threaten our economic welfare and 
even our social and political stability" (Levin, 1989). 

As we approach the 21st century, it would seem 
that "educational reform" is nothing short of "social 
reform." More than working simply to improve 
curricula or upgrade facilities, schools are trying to 
change the way parents and communities operate in 
relation to them. Why? Schools need students who 
are physically and emotionally healthy and "ready" to 
learn if they are to fulfill their charge to produce 
proficient citizens who can think critically and work 
cooperatively. 

This report addressed what and how Arizona 
schools have done to work with pupils whose life 
experiences place them at risk of school failure-those 
who often are not physically or emotionally ready to 
learn. It also addresses program efforts in working 
with parents, staff, and communities towards collabo- 
rating as partners in change. 

This document is based on three years of exper- 
ience with and data from 55 Arizona districts /uid 
schools implementing programs for at-risk youth^ It 
provides some answers for the Arizona policy makers 
who initiated the pilot project. It also raises issues 
and concerns regarding Arizona's current efforts to 
support its at-risk children and youth. 

Have the programs worked overall? YES. Out- 
comes are seen not only in such things as better 
attendance and improved test scores— they are mani- 
fest in more confident stiuients, enhanced relation- 
ships with parents, improved operations. . .not perfect, 
but improved. 

There is still work to be done.... 
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The Arizona At-Risk Pilot Project: 
What Is It? 

The Arizona AhRisk Pilot Project is a longitudi- 
nal evaluation study (1989-92) of 55 district and 
school-based programs for students at risk for aca* 
demic failure. These programs have operated with 
annual appropriations provided by Arizona H.B. 2217 
(1988). On behalf of the Arizona Department of 
Education (ADE), the Morrison Institute for Public 
Policy, School of Public Affeirs, Arizona State 
University » has conducted this evaluation study for 
the purpose of: 

• determining the impact of various strategies on 
targeted at-risk students; 

• developing replicable model components for at- 
risk youth; and» 

^ elucidating the policy issues and options present- 
ed by the pilot project as a whole for Arizona. 

This report provides a synthesis and discussion of 
key evaluation findings to date. Specifically, the 
report reflects on various strategies that appear 
promising fur at-risk youth, and provides recom- 
mendations for state policy makers regarding pro- 
gramming options for Arizona. The fiill report, 
Powerful Stories, Positive Results: Arizona At-Risk 
Project Report (FY 1990-91), provides a detailed 
analysis of all data sets and associated conclusions, 
and is available through Moirison Institute. The 
dcjumentation of replicable model components is 
forthcoming in June 1992, at the conclusion of the 
four-year pilot project. 



Where Are The Pilot Sites? 

The pilot sites are geographically portrayed in 
Figure 1 and listed in Table 1. Sites encompass 42 
programs serving students in grades K-3 and 13 
programs serving grades 7-12. As of spring 1991, 33 
''phase r programs had completed three years of the 
four-year pilot project (funded in FY 1988-89); 22 
''phase ir programs completed their second year of 
implementation (funded in FY 1989-90). Seven of 
these "phase 11" sites were specifically funded as 
jcAouZ-based as opposed to ^ij/ncr-based programs. 



TdUe L Aiizoaa At-Riskl^ PrograiDS 



K-3 



Pbasel 



Phase in 

(B^aw FY 1989-90) 



Creighton 
Laveen 

Muiphy 
Otbom 

Phoenix ElemenUry 
Rooaevett 
m\9(m 



Urban/Suburban 

Avondde 
Isaac 

El Mirage (Dyaait)*^ 
Lot Ranchitoa (Sunnyaide)^ 
Scalei (Teit^e)* 



Rural 



AihFork 

Cooltdge 

Maiy C. O^Brien 

Morriitown 

Nogalei 

Picacho 

Somerton 



Aguila 
Buckeye 
Douglas 
Boy 
Gadsden 

Hyder 

Salome Consolidated 
SUnfield 



Chinle 
Ganftdo 
KayenUi 
Page 

San Carios 
Sanders 

Whiceriver 



Reservation^^ 

Port Thomaa 
Hdbrook 
Red Mesa 
Peach Springs* 
Cameron CTuha City)^ 
Gap (Tuba Ciiy)* 



7-12 



\Jrban/Suburban 
Creighton (7-8) Pima Co. Dclcnlion 

Dysait 
Sunnyside 
Tucson 



Rural 

Nogales 

Pinal County Consortium (9 sites) 
Somerton (7-8) 

Resmatkm^* 

Ganado 
Kayenia 

San Carlos Unified (7-8) 
Sandera 

^ school-funded programs 

♦* ^50% Native American population 



Marana 
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Figure 1. At-Risk Pilot Sites 



• Somorton 
'adsden 



• Ash Fork 




•Page 



o Agulla 



• Morristown 



Buckeye o 
o Hyder 



Metro 
Phoenix ' 



Red Mesa o 
• Kayenta 



o Tuba City 



Chlnle 



• C.olldge 

^ • Mciry C. O'Brien 

Stanfleldo ^'gi^^ 

• Plcacho 



Marona 



Pima Co. 



• Tucson 



Ganado • 

Sanders • 
0 Holbrook 



• Whitertver 

• San Co. J 

o Ft. Thomas 

• Pinal Co. 
Consor^'um 



Detention Center o 8 Sunnyslde 



• Phase I Sites (Began FY 88-89) 
o Phase II Sites (Began FY 89-90) 



♦ Nogales q Douglas 



Metro Phoenix area sites are: 

Phase I - Crcighton, Dysart, Lavecn, Littleton, Murphy, Osbom, Phoncix, Ruosevelt, and Wilson 
Phone II - Avondale, Balsz, Dysart, Isaac, and Tempe 
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Defining •mat Works" 



Table 2. FY 1990-91 At-Risk Pilot Project 
DataSeU 

• atHiik ftudeirt profiloi for 3,618 K-3 and 

1,627 7-12 pupili; 

• program hiitoriei and paiticipaUon data for 
an SS aiUi; 

• nirvoy data from 1,021 K-3 tcachen and 
982 7-12 ttaffj 

• 4,042 commenU from K^3 teachen and 
1,041 commenUfmn 7-12 nUff mcmiben 
on prognm oarvicei; 

• program outcome aueumenu from 986 K- 
3 and 843 7-12 tUffmembert; 

• wrvey dau from 1 ,627 7-12 students; 

• data from 748 interview! involving: 153 
parenU, 460 ichool tuff, 17 ichool board 
memben, 18 community membera, and 100 
7*12 itudcmt; 

• achievement^ attendance.andother'impact* 
datA for 3,958 K-3 and 1,307 7-12 pupUi 
being trackei longitudinally; 

• retentU 71 fitcs and poiiciot for 41 of Uic 42 

K-3 progrsfju; 

• budget information for 53 of the 55 pilot 
dcmonitration projects. 



The question of "what works* was addressed 
using cross-site analyses, identifying patterns of 
program similarities and difTerences-in clientele, 
settings, strategies, and implementation. As patterns 
emerged, they formed a basis for aligning reports, 
interviews, surveys, and forms. The alignment 
generated multiple sources of data that were analyzed 
to discern consensus about "what works" in terms of 
issues such as: nliich programs reach the most 
students, parents, and staff; which programs prompt 
systemic organizational change; and, vsiiich practices 
are viewed as successfiil through the eyes of students, 
teachers, administrators, counselors, aides, parents, 
and community members. 

The evaluation of the 55 programs has relied on 
the premise that understanding program processes and 
implementation strategies employed by districts is as 
important as measuring student outcomes. The 
process is as important as the product. 

Critical considerations included: Who was 
involved in program planning? Did more involvement 
of program staff in program plaiming result in more 
effective practices in the classroom? How important 
was open commimication in bringing about change? 
Were school/conamunity linkages i^nportant in suc- 
cessful programs, and, if so, what type of linkages? 
How did parents want to be involved? And, ultimate- 
ly, what can the state of Arizona do to promote the 
types of changes that will help at-risk students be- 
come successful students? 

Superimposed on the question of "what works" 
was the additional question: "For whom?" This, in 
turn, prompted other questions that figured promi- 
nently in data collection and analyses, such as: How 
similar are at-risk students? Do different kinds of stu- 
dents benefit from different kinds of services? What 
works for parents in terms of increasing parent 
involvement? What works for staff in terms of 
developing the skills needed to work with at-risk 
students and their parents? 

Beginning in summer 1989, Morrison Institute 
compiled comprehensive databases to answer such 
questions. The data sets collected during FY 1990-91 
only are depicted in Table 2. Each database has its 
own merits, caveats, and limitations. Also, each data- 
base is only one of many used in defming "what 
works." 



No single data set fully describes the phenomena 
being examined. Taken as a whole, however, trends 
emerge that are suggestive of programs and activities 
that hold promise for at-risk youth in Arizona and the 
policy issues that need to be addressed to enable such 
programs to continue and flourish. 



"J/* we save one kid a year, the pro- 
gram is worth it. If I didn't think it was 
worth it, I wouldn V have continued to have 
been involved. - program teacher 
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Arizona's At-Risk Students: Who 
Are They?^ 

In general, students at risk are those whose life 
circumstances-being poor, hungry, transient, abused, 
neglected-are associated with low achievement, 
behavioral problems, low self-esteem and other 
factors making them more likely to fail in school and 
drop out. 

As part of the study, 3618 primary and 1627 
secondary at-risk students were profiled during 1990- 
91. Profiles show that at-risk students (K-3 and 7-12) 
generally live with both natural parrats who Lave a 
high school education or less. Mothers (or female 
guardians) are largely not employed outside the 
home, while mosi fathers (or male guardians) occupy 
"blue collar" jobs. Not all at-risk youngsters are 
nec(^.5sarily low achievers: roughly one out of five 
students is perceived as achieving satisfactorily » 

There are some regional variations in factors 
contributing to students being at risk. Urban students* 
home environments are less ^nuclear family-oriented" 
than either rural or reservation students, with fewer 
urban students living with both natural parents. More 
reservation parents (or guardians) reportedly have 
some college than in the iri . J or urban areas. At the 
same time, the percentage of reservation unemploy- 
Lient is higher than in either of the other two regions. 
Finally, rural areas have more students from homes 
in which no English is spoken. 

Arizona's K-3 At-Risk Students 

Beyond family demographics, K-S student 
profiles gathered information regarding "at-risk 
indicators" (i.e., factors identified in the literature as 
contributing to a child being considered at risk of 
academic failure). These indicators, which portray a 
vivid picture of what makes Arizona*s children at 
risk, are presented in Table 3. Analyses by region 
reveal that K-3 students across regions share the same 
"top nine" indicators (shown above the line in Table 
3). 

Arizona's 7-12 At-Risk Students 

At-risk students in the 7-12 pilot projects are 
characterized by a different set of indicators^ as 
shown in Table 4. Regional analyses show that only 
two indicators are in the "top five" for alt regions- 
work/responsibilities interfere witii school, and low 
parent participation. 



Table 3, K*3 ^^Al^'Risk" ludicatort 




% of 3.618 children 


Low parent paiticipition 


59 


Low family annual income 


58 


Few reading/educational materiati 


56 


Low lelf-eiteem 


50 


Low pan&M auppoft 


49 


Poor communicalion with parenu 


47 


Subitandanl home environment 


44 


Low Engliih proficiency 


42 


Bmoiional/behivioral problem! 


33 


2 ichooli attended 


26 


Health problem! 


19 


SubsUnceabuie by parenU 


19 


"Latch-key* lituation 


19 


Abualve home 


18 


Reaponaible for Ukinf care of aiblingt 


18 


TranBtence/mobiliiy 


17 


Reuined >. 1 time 


16 


Immigntion to the U.S. within 3 yean 


12 


Siblini dropout(a) 


9 


Subiunce i^uae by child 


5 



Table 4. 7-12 '^At-Risk" Indkatora 




% of 1.627 ttudenu 


Work/reapontibilitief interfere w/ichool 


53 


Not involved in commuoity/Khool 


44 


Suipended/expelled 


38 


Held back^ 1 elementary grade 


37 


Low parent participation 


36 


DropoutT kick-out" 


33 


No telephone 


30 


Suicidal ideai/deedi 


30 


Sibling drcipout(a) 


29 


Fecti uniafe at home 


21 


Convicted of a crime 


21 


Skipped achool weekly 


14 


Dniga/akohol weekly 


13 


>^ 3 lehoola in 2 yean 


12 


Subitandard home 


11 


Hai children 


9 


Low parent yuppott 


7 


Immigration to the U.S. within 3 yearn 


5 


Poor health 


5 
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Comparing regional data> greater percentages of 
urban youth are characterized by more indicators than 
their rural and reservation peers. Youth in nwal and 
reservation areas are uniquely characterized by 
factors related to regional and environmental differ- 
ences (p.g.p few telephones on reservations). 

Grade level analyses suggest that students in 7-8 
grade programs are not as seriously at-risk as their 9- 
12 counterparts. Findings imply that "at-riskness" is 
a developmental phenomenon to some degree^ and 
that early intervention might forestall certain at-risk 
behaviors. 

There are clearly distinaive aspects of at-risk 
youth across Arizona, with different groups of 
students presenting different pictures of what it means 
to be "at-risk. " 



Achievement and ''At-Riskness" 

Data were analyzed to show the relations be- 
tween at-risk indicators and student achievement. The 
degree of negative effect of each K-3 indicator is 
depicted in Table S. As perceived by K-3 teachers, 
low achievement is most associated with a lack of 
reading materials at home» low self-esteem, and home 
environments that are "dyslunctional." However^ top 
indicators perceived as adversely affecting achieve- 
ment vary by region: ^or urban children, parental 
substance abuse is the top indicator; rural teachers 
felt that a lack of reading materials and low self- 
esteem most severely affected their students. Teach- 
ers serving large percentages of Native American 
children believed low self-esteem had the most 
negative effect on their student population. 

One finding deserves pariicular mention, espe- 
cially in view of H.B. 2217 (1988) requirements for 
schools to involve parents in their children's educa- 
tion. As expected, K-3 teachers indicated that large 
percentages of children are affected by a lack of 
parental participation. But a lack of parental support 
is believed to have a more severe negative impact on 
achievement. 



Tabie5« Dcfrw of Nefttifc Effact of At* 


lUak ladkat^rs K-3 ARliie?eoi€ot 


Few leadif^ miteriili 


3.21 




3.21 


SubiUuice abuse by parents 


3.18 


Abusive borne environment 


3.15 


Einotiofisl/brhavionil problems 


3.14 


Low psrem support 


3.11 


Poor eommunicsiion with parents 


3.11 


Low Ei^sh profictency 


3.06 


Transtence/mobility 


3.04 


Low parent partipipation 


3»04 


Heahh problems 


3.04 


Recent immigration 


3.01 


Substandard home 


2,97 


i#aicn-Key home 


2.96 


Low annual income 


2.96 


>. 2 schools attended 


2.92 


Care for siblings 


2.74 


Sibling dropout(s) 


2.72 


Sub. abuse by child 


2.76 


Reuined ^ 1 time 


2.59 


No indicator(s) < 


2.50 


^ Lines divide fmges of mean scores snd can be 


intefpreted using the following scsle: 




2.0 - NO negative effect on achievement 




3 0 » SOME negative effect 




4.0 * LARGE negative effect 





Among 7-12 students the number of at-risk 
indicators rises as achievement levels drop Lov^^ 
achieving at-ris '^tudents are characterized to a 
greater degree as: 

• Uninvolved in school/community activities 

* Retained in at least one elementary grade 

• Having a sibling who dropped out of school 
^ Having dropped out themselves 

* Having been suspended or expelled 
^ Having been convicted of a crime 



Specific indicators have been showL to distir- 
guish between high and low achieving K-3 at-ri^k 
students. Across all regions, one inAxzsXox-English 
proficiency-^is consistently associated with achieve- 
ment. Low achievers overall are less English profi- 
cient than are high achievers. 
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No More Business As Usual 

One of the at-risk pilot sites adopted the motto: 
No More Business As Usual. It is a motto that is 
apropos to the 55 public school districts across the 
state as they united in a campaign to intervene in the 
lives of over 35 000 pupils "environmentally" at risk. 
Innovative initiatives were launched to develop and 
enhance educational alternatives; nurture competent 
and compassionate staff; foster reciprocal relations 
between schools and parents; and create collaborative 
partnerships with businesses and social service 
agencies. 

Among the 42 K-3 pilot sites, a wide variety of 
intervention strategies were employed. Nine key 
strategies (shown in Table 6) encompass K-3 pro- 
grams* efforts to enhance the educational environ- 
ments and experiences of at-risk youngsters. 



The 13 programs (21 sites) serving 7-12 "re- 
trieved" dropouts and potential dropouts offered a 
continuum of programs ranging from off-site alterna- 
tive schools serving exclusively at-risk teens to 
"school-wide" reforms serving all students. As shown 
in Table 7, both comprehensive, "holistic" programs 
and "discrete" services were offered. 

Sites serving students in grades 7-12 were 
charged with integrating academic, vocational, and 
f/upport senrices. Essentially, the following services 
are representative of the types of services most fre- 
quently incorporated within their programs: 



table?. 7-12 Ddifeiy Syttems 

• AheroiUve School» 

• Schoolt-WithlfhSchooSs 

• Aeademic Ckna/Labi/AcUvitiet 
^ Vocattoaii CtiMe«/Labi/Activilie« 

• Support CliMCt/Laba/ Activities 

• Totar School Reform 



Academic/Instructional Services: 

• Small group instruction 

• One-on-one tutoring 

• Computer-assisted instruction (CAI) 

• Self-paced ciuriculum 

Vocational Services: 

• Applied academics 

• Employability skills 

• Career awareness activities 

• Vocational/occupational training 

• Work experience/Entrepreneurial activities 

• Vocational assessments 
^ High Tech labs 

Social/Support Services: 

• Life/study skills classes 

• Personal counseling (individual, group, family) 

• Formal student monitoring 

• Formal student mentoring 

• Social service linkages/referrals 

Getting Parents Involved 

H.B. 2217 (1988) required K-3 districts to 
identify "procedures for involving parents in the 
program. " At the same time. State Board criteria for 
7-12 programs required ' parental communication" in 
conjunction with direct student services. 

Both K-3 and 7-12 efforts to involve parents as 
partners in education included the following: 

• increasing home/community outreach efforts; 

• increasing opportunities for school involvement; 

• upgrading parent skills; and, 

• providing counseling/social services. 



Table 6. SCtideat Senrice Strategics 

• AtterMtivo Delivery Syitemi 

• Full-dty kindergifUns 

• MutU-yeir cUuroomi 

• Multi-graded clatitoomi 

• Reduced Studeiit<^UfriUUoa 

• Ahend CtaMTOom Imtniction/ 

Curriculum ModificatioDS 

• Suppkmentat Individualized InitmcUon 

• Support/Enrichment AcUvitiei/Scrvicei 

• Summer Seivicea 

• Improved Facilities 

• Enhanced On-Cfoii^ Student Aucffrmcnt 

• Expanded CouAieling/SooiaiServicet 




n 
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Broadly defined, outreach efforts entailed school 
personnel giving information and/or delivering 
services to parents in their homes and communities. 
All 55 programs offered some type of home/ 
community outreach, typically through increased 
written or verbal communication. A number of 
districts also conducted formal home visits, and many 
K-3 programs aimed to involve parents with their 
children by assigning instructional activities to be 
completed jointly at home. 

Program staff also made efforts to increase 
parent participation through on-site school activities. 
These efforts included three major categories of 
participation: parents as classroom volunteers, parent 
membership on school advisory boards for the at-risk 
program, and parent participation in school "events." 

A majority of K-3 and some 7-12 programs 
attempted to involve parents by offering workshops 
and presentations on a variety of topics. Additionally, 
several districts offered or sponsored formal classes 
to upgrade parents* own skills (e.g., ESL classes). 
Finally, some at-risk programs also attempted to 
address the physical, social, and economic needs of 
parents by providing referrals to social service 
agencies or counseling on topics such as student 
absenteeism or drug abfise. 

The Right Staff 

Many K-3 at-risk programs focused on staff 
development, particularly during their first implemen- 
tation year. Although staff development was not an 
area of emphasis for 7-12 programs, mmy sites 
supported additional staff training. At both the 
primary and secondary levels, training was provided 
through: 

• workshops and/or in-service; 

• conferences and academies; 

• formal clashes (e.g., college courses); 
^ formal at-risk program meetings; and, 

• school visits and observations. 

Workshops/in-service training addressed a variety 
of subjects. They were led by peers and professional 
consultants, and were offered on and ofT-site. Most 
districts also sponsored staff attendance at profes- 
sional conferences, academies, or other evcnis that 
offered several days of training on a related topic. 
ADE*s K-3 Academy is a prime example of a well- 
received training opportimity in this category. 



Districts also sponsored staff participation in 
university, community college, or other training 
classes. Generally, these classes resulted in college 
and/or district credits. In a few districts, staff devel- 
opment occurred in the context of specially designed 
program meetings intended to provide staff with 
hands-on training in various aspects of program 
evaluation and implementation. 

Finally, several programs sponsored visits by 
their staff to other schools. These visits allowed staff 
to observe other programs in operation, and provided 
opportunities to acquire new skills and ideas to 
enhance their own at-risk programs. 

How Many People Were Served 
By The Programs? 

During FY 1990-91 alone, at-risk programs: 

• served neariy 35,000 at-risk pupils (over 24,000 
K-3 students and an estimated 9,385 7-12 stu- 
dents); 

• touched over 10,000 parents of at-risk pupils 
(roughly 9,210 parents of K-3 pupils and 1,532 
pikrents of 7-12 students); 

• recorded over 6,500 staff participants in various 
training activities (with m estimated 5,470 K-3 
and 1,068 7-12 participants attending workshops 
and other in-service activities). 

So...What Does "Work^^ For K-3 
Students? 

Key early childhood strategies identiFied as "prom- 
ising^ include: reducing student-staff ratios, 
implementing full-day kindergartens, and supple- 
menting individualized instruction. 

Reduced student-staff ratios, full-day kinder- 
gartens, and tutorial programs (particularly those 
delivered during the school day) consistently appeared 
as "effective" strategies holding promise for at-risk 
youth. National research supports this finding. Tliese 
strategies share one critical feature: children receive 
more, and more individualized, time and attention. 

Although the interpretation of clas5. size research 
has been highly controversial, a recent meta-analysis 
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of class size reseArch reveals that smaller classes 
result in higher student achievement, and these effects 
are cumulative (Mitchell & Beach, 1990). Further, a 
longitudinal experimental study of class size shows a 
large positive effect for minority students (Finn & 
Achilles, 1990). The minority factor is particularly 
germane to this at-risk study since over 80 percent 
Arizona*s pilot program students are ethnic minori- 
ties. 

Interview respondents praised those school 
districts that had hired additional teachers and aides 
in an effort to reduce class sizes and student-stafT 
ratios. The main benefit of these efforts, parents and 
staff said, was that students received extra individual 
attention. 

• Regarding one student who had benefitted from 
extra attention, an urban teacher said; **[Before] 
they would have j. H dumped him In a special 
education class. Nothing was really wrong with 
him. He just needed time to develop." 

Extending the traditional half-day kindergarten 
schedule to a full day appears to be another prom- 
ising practice for serving at-risk studrats. A recent 
review of the research on hill-day kindergarten 
(Puleo, 1988) reveals that the available evidence 
largely favors full-day programs over half-day, 
particularly for lower ability and low socio-economic 
status (SES) students. Additionally, achievement 
effects are shown to be long-term, with favorable 
flndings continuing when students are followed into 
the upper grades, even as high as eighth grade. 

Urban parents and staff, in particular, frequently 
cited full-day kindergarten as one of the most effec- 
tive componmts of an at-risk program, with one 
parent noting it was an "absolute necessity.* 

Parents and staff also applauded tutorial pro- 
grams. 

• Said an urban teacher:"! donU know how we 
functioned without [the tutors]... it is ^.'^ry diffi- 
cult to individualize to the extent that some 
children need, and the in-class tutoring program 
has made this possible. " A reser/ation teacher 
echoed these sentiments: "We might be sending 
non-readers on to third grade if it were not for 
this one-on-one opportunity." One mother said 
singly: "My son feels that he is being helped. " 



Teachers believed that tutorial programs were 
effective, but only if implemented under the appro- 
priate conditions. For example, before- and after- 
scho^ ^ tutorials were not as well-received as during- 
school programs. If tutorials were conducted during 
school, teachers preferred that they took place within 
the classroom setting rather than on a pull-out basis. 
Ofher considerations for delivering tutorials were the 
frequency and intensity of the tutoring, the process by 
which students are identified, and the skills identified 
for tutoring. 

In general, "promising practices" for at-risk 
children appear to be those that increase both indi- 
vidual attention and instructional time for students. 
Notably, these are also costly reforms. 

Developmentally appropriate practices (DAP) 
appear promising, but evidence is inconclusive* 

The use of DAP is desirable and well-supported 
in the early childhood literature and research. As 
defmed by the National Association for the Education 
of Young Giildren (Bredekamp, 1987), these types of 
practices address the total educational environment of 
children including curriculum, teaching strategies, 
social-emotional development, motivation, parent- 
teacher relations, the physical environment of class- 
rooms, evaluation techniques, and class size, among 
other factors. 

Within Arizona, virtually all K-3 at-risk pilot 
programs focused on the increased use of DAP 
throu ;h implementing curriculum modifications 
incorporating "whole language" and experiential math 
programs. Many programs used at-risk funds to 
purchase the instructional resources needed to imple- 
ment DAP, such as classroom libraries, books with 
audiotapes, and math manipulative materials. 

However, the actual effectiveness of DAP in 
Arizona's at-risk pilot programs was difficult to 
assess because of wide variations in the extent to 
which they were understood and employed. In addi- 
tion, DAP tended to be incorporated into other 
intervention strategies, making it difficult to separate 
them for analysis. Morrison evaluators, ADE person- 
nel, and some district personnel have expressed 
concerns regarding apparer.t inconsistencies in the 
understanding and imple0!<entation of DAP. Further 
district efforts xe required to enhance uniformity of 
practice so there can be meaningful analysis of 
whether or not these practices "work" with Arizona's 
pt-risk pilot students. 
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Nevertheless, parents and staff generally agreed 
that DAP worked. These pnctices, said parents and 
staff y had made language arts and > 'Hth "fiin*' for 
children. They had also helped raise students' self- 
esteem and rathusiasm for school. Among the com- 
ments: 

• "The holistic curriculum is why my son is in 
this school," said one urban mother. "The [at- 
risk program] sneaks learning in with the fun 
stuff," a rural pare .i said. "[My daughter] is 
excited about school," said a reservation father. 

Many staff pointed out that a transition to devel- 
opmentally appropriate practices requires a wealth of 
new instructional materials. As noted, in numy cases 
program funds were allocated to purchase these new 
materials, prompting one veteran reservation teacher 
to call it "a dream come true." Teachers, in general, 
were extremely positive about the benefits of new 
materials for oiriching the educational environments 
of the students. But, staff and parents said that many 
more nem educational materials were needed, espe- 
cially in rural and reservation schools. 

^ Lamented one rural teacher: "You can't use 
whole language without books." A frustrated 
reservation teacher asked: "How can we do 
hands-on activities when we don*t have materials 
for the kids?" 

The implementation of developmentally appro- 
priate practices needs to be assessed further. 

...And What "Works" For 7-12 
Students? 

In this evaluation, alternative programs appear 
most ^promising" for at-risk 7-12 students; how- 
ever, other delivery systems did produce positive 
outcomes related to the services they provided 
(e.g., vocational services produced vocational 
outcomes). 

There is a great deal of program diversity at the 
7 -12 level. This diversity added to the complexity of 
the evaluation efforts undertaken and produced 
findings that suggest that each type of program has 
some specific merits. For example, alternative and 
school-within-school students rated behavioral and 
attitudinal outcomes positively "across the board;" 
academic components produce positive academic 
outcomes; vocational components produce positive 



vocational outcomes; and support service components 
produce positive outcomes related to self-esteem and 
coping skills. Which practices are most promising? It 
deprads. 

The Holistic Models 

1) Alternative Schools: Evaluation results 
consistently point to the alternative school model as 
the most effective and positively perceived delivery 
system for at-risk students at the secondary school 
level. By incorporating a variety of instructional, 
vocational, and support strategies into a comprehen- 
sive system, customized to the unique and diverse 
characteristics of older at-risk students, alternative 
schools seem to be providing f viable option for 
students who have been disenfranchised from the 
"regular" educational system. While mainstreaming 
and heterograous grouping are important goals for 
serving at-risk students at the primary level, this 
approach may not be as desirable for older students 
who appear to function well when grouped with 
students similar to themselves. 

The "credibility" issue is important in looking at 
the alternative school, since there is a perception 
among non-alternative school staff that they offer an 
"easy out" for students who have not succeeded in the 
mainstream. High academic standards and quality 
curriculum must be in place if alternative schools are 
to be viewed as a positive intervention for at-risk 
students. 

Regional differences must also be considered; 
eight of the ten alternative schools in the pilot project 
are in rural areas. Alternative schools may not be the 
best delivery system for reservation districts where 
the majority of the population is r/ir<>i(lered to be at 
risk. But the concept of an ' A^^^^it^ versus a 
fragmented, delivery system s. ! > . provided 
through alternative schools deser . isider£..^on. 



"/ know people say this school is for 
trouble makers, but that's only when tftey 
start. When they finish, they will be differ- 
ent. ...This school lifted me to a higher 
level in life and I will never forget how this 
school treated me. " -7 7-year old student 
in an alternative school 
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2) Schools^Within-Schools (SWS): The SWS 
model provides educational programming that is a 
compromise between alternative schools and main- 
streaming programs, and their effectiveness is also 
shown to be somewhere in the middle in terms of 
student and teacher perceptions. Students, however, 
consistently rated behavioral and attitudinal outcomes 
positively, and were the only group of studoits to do 
so other than alternative school students. 

3) Sr!iool-Wide Reform: Another holistic 
approach inq)lemenu in two at-risk programs is 
school-wide reform. Only one of these efforts was 
formally assessed as part of this evaluation: a reser* 
v^t'^n program that instituted a four-period day 
during year three of the project. This school reform 
model has affected every student in the high school, 
all of whom are considered to be at risk, as well as 
every staff member. After the first year of implemen- 
tation, responses to the change wore positive overall, 
with students somewhat more positive than staff. This 
totally integrated approach to serving at-risk students 
wai rants close examination and may be particularly 
applicable for reservation sites with large at-risk 
populations. 

The "Discrete Irtervention" Models 

1) Academic and Instructional Strategies: 
Academically-focused activities produced feelings of 
academic success anoong students. However, there 
was no consensus between students and teachers 
about which instructional strategies were most effec- 
tive. Students preferred self-paced instruction, while 
teachers believed that this method does not provide 
adequate direct instruction. Computer-assisted instruc- 
tion appeared to be effective when used as one aspect 
of a comprehensive program, but not as a stand-alone 
strategy. Tutorials were well-received, but again must 
be planned as a part of an integrated system. In sum, 
each separate instructional strategy appeared to be 
effective only in terms of how well it was incorpor- 
ated into a total synergistic system. 

2) Vocational Services: The wide range of 
vocational services implemented resulted in in^roved 
attitudes and abilities in work-related areas. Students 
enrolled in vocational programs reported an increased 
awareness of career opportunities and felt better 
prepared to enter the workplace than students not 
enrolled in these programs. Although staff believed 
that vocational services were effective, they also felt 
that vocational opportunities were limited and some- 
times difficult to access. 



3) Support Services: More is the operative 
word. Support services were viewed positively by 
most students and resulted in better self-esteem and 
coping skills. Especially among students in 7-8 pro- 
grams, support services were rated highly. Because 
at-risk behaviors are not as pronounced at this level, 
support services may be particularly desirable in 
these grades. Perhaps more severe at-risk behaviors 
could be averted by intervening earlier with more 
support. At all levels, however, more qualified social 
service staff are needed to serve more students in a 
timely manner. 

Since clear conclusions regarding the most 
effective strategies for secondary level at-risk students 
were difficult to establish, Morrison institute staff 
revisited national at-risk literature, specifically 
reviewing studies pertaining to interventions similar 
to those evaluated in the Arizona At-Risk Pilot Project 
(e.g., alternative schools, tutorial programs, and 
vocational and social services). Throughout the 
national literature, similar research problems were 
documented (e.g., limited access to longitudinal 
quantitative data on student outcomes) and inconclu- 
sive results were reported regarding "what works" 
(Catterall & Stem, 1986; Gold & Mann, 1984; 
Reilly, 1986). Much of the research validated such 
notions as: 1) implementation processes need to be 
assessed, and 2) attitudinal changes are important 
student outcomes. The conclusion of the Gold and 
Mann study is particularly relevant to the present at- 
risk evaluation: 

"Whether programs are successful will vary from 
student to student, teacher to teacher, program to 
program... But exploration of the underlying 
processes has shown that those programs did 
indeed produce marked change in particular 
attitudes and perceptions of certain identifiable 
students in a way conducive to better behavior 
and greater scholastic achievement" (p. 160). 

Evaluation findings strongly suggest the need for 
more "holistic" approaches to working with at-risk 
teens. While such self-contained programs hold 
promise, however, they may not be realistic options 
in some areas. 

Discrete services can be effective, if "impact" is 
sought in a discrete skill. Nonetheless, a better 
solution for implementing discrete services is greater 
systemic integration of services for meeting the needs 
of the "whole" student. 
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What Evidence Is There That 
Programs Made A Difference? 



Hsure 2. K-3 Absaitoe Rates (N»2353) 
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7-12 Abscfltee Rates (N=527) 
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In addition to bi-annual site visits, extensive 
program documentation, hundreds of interviews, and 
thousands of survey results, selected studrat outcome 
data were analyzed for both K-3 and 7-12 students. 
Evaluation data indicate that, overall, students are 
making academic progiess in the areas of attendance, 
achievement, grade promotion, and credits earned. 

Student Attendance: Based on the assumption 
that student learning is adversely affected by high 
rates of absenteeism, evaluators examined variations 
in student attendance during the program implementa- 
tion period. 

Tracking 2353 K-3 students and 527 students in 
grades 7-;2, FY 1990-91 data reveal that absen- 
teeism-for both groups of students-is the lowest of 
all three years studied (Figure 2). 

• For K-3 students, absenteeism rates have decVoed 
steadily throughout the implementation period of the 
at-risk programs. 

• For 7-12 students, absenteeism has declined, 
reversing a two-year trend. 

Reduced absenteeism implies that students 
received "additional** instructional days. Programs 
also **increased** instructional time through such 
strategies as one-on-one tutorial assistance and 
sununer school. Thus, it may be concluded that both 
the quantity and quality of instructional time were 
addressed by at-risk programs. 

At both K-3 and 7-12 levels, there were regional 
variations in attendance patterns. Specifically, among 
reservation students tnicked longitudinally, attendance 
decreased steadily (i.e., absenteeism increased). 

K-3 Student Achievement: FTBS scores for approxi- 
niately 550 students for whom diree years of data 
were available were examined to discern any changes 
in test performance over time. Three-year trends in 
student achievement were examined using normal 
curve equivalent (NCE) scores. (NCE scores were 
used to compare a student^s gain with the average 
gain for similar students who took the test. If the 
student grew, but less than the •*average** student, the 
NCE declined.) 



Net NCE gains were made in reading and lan- 
guage over the three-year period, while math NCE 
scores declined. In other words, reading and lan- 
guage subtests revealed average growth (or more), 
while the math subtest showed less than average 
growth (Figure 3). 
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Data analyses suggest that aggregate trends can 
be misleading. For example, between 1990 and 1991, 
pupils in all regions showed gains in reading, but 
actually only urban children made steady growth, 
while rural and reservation children remained rela- 
tively stable. Also, most of the overall decline in 
math scores can be attributed to reservation children 
who represent nearly half of the children remaining 
in the cohort. 

One thing is important to remember: declines in 
NCE scores do not mean that students made no 
progress. In fact, looking at grade equivalent (G.E.) 
scores, all students, in all areas, showed steady 
developmental progress over the three year period. In 
general, however, students* end-of-year grade equiva- 
lent scores show that they would enter the next grade 
slightly below grade level. 



• '/ have sem progress in many of the 
at-risk pupib. Htwever, we are not reach- 
ing alio/ them....'' 

• 'Many students are struggling to 
learn English a second language, so... 
many are still behind a year.... * 

• ''The emphasis on standardized test 
scores does not provide opportunities for 
creative teaching techniques which at-risk 
pupils need. * 

• I have seen some improvement in the 
academic performance of the dtildren 
labeled as at-risk.. since the adoption of 
this program by my district.... " 

• The consistency of the whole Ian- 
guage curriculuTft and the immersion of 
children in a literate environment keeps the 
students ^on-track^" 

*^K-3 program teachers 



figon 3. K 3 Cohort ITBS NCE Rwihs 
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7-12 Student Achievonent: ITBS and/or TAP 
scores were examined for over 260 students for 
whom three years of data were available. Three-year 
trends in student achievement were examined, as 
based on NCE scores. As Figure 4 shows, there are 
gains in all three areas compared to FY 1988-89 
NCE scores, with most gains reflected in language. 

Regional analyses show that, in a majority of 
cases, rural at-risk students are ou(-performing their 
urban and reservation peers in all areas. Notably, 
reservation students demonstrate considerably lower 
reading scores than their peers. 



• "The [district is] totally committed to 
assisting students to stay in school and 
having programs which will give students 
appropriate skills when graduating. Many 
concerns for making this happen in this 
rural community are being addressed. " 

• "To get academic credit, our fat-risk 
program] students have to stay on-task, 
and demonstrate knowledge in a subject 
area comparable to the regular doss- 
room," 

•'Our programs still need a lot of 
work, but we are trying to. . . meet the needs 
of our students cj well as maintain the 
academic environment. * 

7-12 program st(^ 



As with K-3 scores, FBS/TAP NCE scores were 
also examined in relation to more "meaningful" grade 
equivalent (G.E.) scores. The analysis showed that 
students are making steady developmental progress 
from grade-to-grade. However, the question was 
posed; "What kind of progress is being made?" 

The median and range for grade equivalent 
scores by grade level using FY 1990-91 daU are 
depicted on the next page (Table 8). Using the 
median (which indicates the grad^ equivalent at which 
50% of the students score below and above), a 
majority of students demonstrate skills "below" grade 
level. Range scores, however, reveal the variation in 
individual student skill levels and show that there are 
students performing at or above grade level as well. 



Figure 4. 7-12 Cohort ITBS/TAP NCE 
Rcmiti (1989-91) 
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Table 8. FY 1990-91 Gnit EqniTalcnt ITBS/TAP Scorn For 7-12 Cohort (N - 264) 


FY 1991 Grade 
Levels^ 


Reading G.E. 
Mediao Range 


L4Uiguage G.E. 

Median 


Range 


Math G.E. 

Median 


Range 


8th (n < 81) 


6.8 3.4-19.8 


6.8 


4.1-19.5 


7.2 


5.0-19.2 


9\h (t\<_ 76) 


7.8 3.0-14.7 


7.9 


4.2-14.4 


7.6 


3.6-13.2 


10th (n < 35) 


:.6 3.6-16.2 


8.1 


4.0-14.0 


7.8 


4.9-16.2 


lllh (n < 43) 


8.2 3.7-17.1 


9.9 


4.2-14.0 


8.1 


4.8-14.0 


12th (n<.24) 


10.3 7.0-14.4 


9.9 


6.0-13.5 


8.7 


5.0-15.8 


♦ E«ch designated gnde level represent a subgroup of the cohort for whom three years of data were available. Therefore, 
eighth graders were 1988-89 abcth graders and 1990-91 seventh graders, and so on. 


1991 



Another analysis of standardized test scores 
examined the exit skills of students leaving grades 
three and 12. Third and twelfth grade students' NCE 
results were compared for two consecutive years, 
since changes in scores may reflect changes as a 
result of program participation (even though there are 
other variables which contribute to such changes). 

Figure 5 (pag: 16) shows that exiting third grade 
snidents in FY 1990-91 performed higher than their 
FY 1989-90 counterparts in reading, language, and 
the composite. Math NCE scores, however, declined. 
Seniors graduating in 1991 exited with higher level 
language and math skills, and lower reading skills, 
than their predecessors (Figure 6, page 16). 

With respect to overall ITBS findings, it is 
encouraging to find increased language skills at both 
the K-3 and 7-12 levels. Much research indicates that 
language proficiency is a key "predictor" of academic 
success, and evidence derived from this evaluation 
study corroborates this finding. 

K-3 Student Promotion/Retention: In theory, 
repeating a grade is supposed to provide a child with 
a "second chance" to master skills. But recent re- 
search (Center for Policy Research, 1990; Shepard & 
Smith, 1989) illustrates that retaining, or "flunking," 
children is of questionable value: if any gains are 
made duiing the repeated year, they are short-lived. 
Further, it has been found that children who have 
been retained are nmre likely to drop out of school 
later in life than children who have not been retained. 
Considering both the costs educating a child for 
one additional year (or morv , and evidence suggest- 



ing that retention does uot provide long-term benefits, 
alternatives to reter/iion might be more cost effective. 

It is posited that the greater the use of education- 
al alternatives to providing remediation, the less the 
need for retention as an educational solution. Since 
many at-risk pilot sites attempted to us^ research- 
based alternatives to retention, Morrison Institute 
evaluators investigated the incidence of retention at 
these sites. Findings through FY 15^90-91 indeed 
showed a decline in retention rates during the period 
of at-risk pilot program implementation (Figure 7). 



Figure 7. K>3 Retention Rates (1988-91) 
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FSfune 5. A CooiMuiMa of 1990 wd 1991 Hull Gr«k StudoiU' ITBS Scorn 
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Hfiire 6. A Compuriaoo of 1990 ind 1991 Twelfth Grade Students' TAP Scorn 
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The evaluators also explored whether or not at- 
risk programs directly contributed to lower retention 
rates by administering a special survey on retention. 
Responses to the survey were enlightening. For the 
most part, pilot districts did not have specific reten- 
tion policies or share defimtions of what constitutes 
a retention. Moreover, no standard criteria for 
making retention decisions existed among districts. 

The retention survey also addressed the question 
of whether or not retention policies had changed since 
and/or because of at-risk program implementation. 
Over half of the 42 pilot sites (23 districts) responded 
that there had been policy changes since the im- 
plementation of the K-3 at-risk program which had 
affected both policy and practice. Several districts 
indicated that, as a result of the implementation of the 
K-3 at-risk program, they had already or were 
currently reviewing, evaluating, revising, and adopt- 
ing retention/promotion guidelines wd policies. In 
summary, many districts focused attention on reten- 
tion policies, and many instituted changes, because of 
the emphasis of the at-risk programs on students most 
likely to be retained. 



7-12 Credits Earned: Twenty credits are re- 
quired by the state for graduation, and therefore, five 
credits is the "average" number of credits needed per 
year for four years of high school. Analyses were 
conducted to determine how many students were "on 
track" toward grad^iating, both in terms of credits 
earned during F /90-91, and in total cumulative 
credits. 

For all students for whom data were available for 
both FY 1989-90 and 90-91 , a little over one-third of 
the students (35 percent) earned Jive or more credits; 
about two-thirds (65 percent) earned less than five 
credits. 

Table 9 shows that half or less than half of the 
students in grades nine through 11 are "on-track" in 
accumulating an average of five credits annually, 
while 71 percent of the twelfth grade students have 
accumulated enough credits to graduate. The shaded 
area indicates those students who are not on track, 
and might be considered "overage" going into the 
next giade. 



Table 9. 9-12 Cuaiilatife CredHs Earned (as of FY 1990-91) 
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Summary of Student Outcomes 

For K-3 Prograk'iis: 

• A trend toward decreased absenteeism has occurred 
since the inception of at-risk programs; this implies 
that children are receiving "additional" instructional 
days. These additional days, combined with modifica- 
tions in the types of services children receive, mean 
that at-risk pilot sites are addressing both the quantity 
and quality of instructional time. 

• Teachers perceive, and data confirm, that students 
are making developmental progress. 



• For the children represented by the K-3 cohort: 1) 
ITBS NCE results show student progress in language 
and reading-the two areas emphasized within the at- 
risk programs; ITBS NCE scores show net declines 
in math; and» 2) ITBS GE scores show that students 
are making steady developmental progress from year- 
to-year in all areas, but are still advancing "below 
grade level." 

• For consecutive grOi vs of third grade children 
represented by the K-3 y)hort, ITBS NCE results 
show progress in reading and language, and declines 
in math. 

• Consistent results indicating net gains in reading 
and language are encouraging, particularly because 
these fikilis tqipeor nKKt predictive of academic achiev 
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• Consistent results indicating below-average devel- 
opmental growth in math indicate a need to review 
math curricula to determine whether math skills are 
receiving adequate attention, or whether poor UBS 
scores are a result of test-curriculum incompatibility. 

• Decreased retention rates have been observed in at- 
risk sites, and there is some evidence that these are 
associated with at-risk program implementation. 

For 7-12 Programs: 

• Absenteeism decreased for the first time (in FY 
1990-91) since the inception of at-risk programs; 
thus, at-risk youth received "additional* instructional 
days. 

• For the teenagers represented by the 7-12 cohort: 
ITBS/TAP NCE results show relatively stable perfor- 
mance in reading and math, and an overall trend 
toward increased language skills. 

• For the teenagers represented by the 7-12 cohort: 
ITBS/TAP NCE results, when converted to grade 
equivalent scores, show that students are making 
steady dev^ iopmental progress; however, a majority 
of students still are advancing "below" grade level. 

• For consecutive groups of seniors represented by 
the 7-12 cohort, TAP NCE results show that FY 
1 990-91 students are exiting with higher language and 
math skills, but lower reading skills than their piede- 
cessors. Overall performance has renuuned stable 
between years as reflected by the composite scores. 

• Results indicating net gains in langimge are encour- 
aging, as these skills are correlated ' academic 
achievement; low reading levels, however, are cause 
for concern-particularly among reservation youth. 

• A majority of students are not earning an average 
of 5 or more credits per year. 

• A majority of students in grades 9-11 are not "on 
track" regarding cumulative credits earned; however, 
71% of the twelfth grade students longitudinally 
tracked earned sufficient credits to graduate. 



What About Parent Involvement? 

Research Findings suggest two distinctly different 
aspects of "effective" parent involvement: parent 
support and parent training. 
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Efforts to involve parents were required as part 
of the K-3 at-risk legislation, and all programs did 
indeed offer parent involvement components. Overall, 
parental involvement is believed to have improved 
since the initiation of the at-risk programs, but much 
more progress is needed and desired. 

Much was learned from the evaluation about the 
lives of at-risk children and their parents. Many 
parents exist in a cycle of poverty and lack the most 
basic necessities. By and large, they are not well- 
educated, and speak English pooriy if at all. Most 
care about their children, but do not feel comfortable 
in the school environment because they themselves 
met with failure there. 

One key finding centers on K-3 teachers' percep- 
tions of parental support. Although lack of parent 
participation is considered pervasive, it does not have 
as negative an impact on a child*s achievement as 
lack of support. Therefore, garnering parenlal support 
becomes a de facto role of schools attempting to 
improve the educational outlook for their at-risk 
students. Evaluation results indicate that the most 
effective means of getting parent participation is 
through social events where food is served. But, to 
build parent support, verbal, one-on-one communica- 
tion from the classroom teacher or another staff 
member is the best strategy. 

Parent workshops, particularly of the "hands-on" 
variety (e.g., make-and-take), have been shown to be 
somewhat effective. These workshops, however, tend 
to reach a relatively small number of parents-often 
not the ones who need the contact most. In rural 
areas, classes that upgrade parents' own skills (e.g., 
ESL a^'l G.E.D.) have met with some success. In 
sum: 

1) Parent involvement initiatives, targeted specifi- 
cally toward parents of at-risk youth, should first 
consider the existing level of parent support. Garner- 
ing support seems a necessary prerequisite for parent 
involvement. Activities that promote school-parent 
rapport and establish schools as comfortable, non- 
threatening environments may initially hold more 
promise than parent workshops or other parent 
training activities. 

2) Workshops that require the aaive participation 
of parents are more successful than those that merely 
present information; adult education classes also hold 
promise for eliciting parent support and participation. 
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Parent participation is problematic at the higher 
grade ie?els. 

The older the student, the less parent involve- 
ment, and the lower the expectations that schools 
should expend resources to gamer parrat support and 
involvement. Some staff firmly believe that schools 
should be reaching out to more parents; others are 
adamantly opposed to spending their time and energy 
on what they perceive as "not my job." Still, the 
same strategies that work in the primary grades work 
at the secondary level; namely, holding school events 
and making personal verbal contacts. Middle school 
students responded more positively to the benefits of 
increased parental support than did 9-12 stud^ts. 
Therefore, parents of middle school students appear 
more likely to respond to these strategies than do 
parents of high school stud^ts. 

Parent involvement is h^j^ among 7-12 pro- 
grams. Given that parent participation is socially 
perceived as desirable, it may be beneficial to devel- 
op initiatives specifically targeted for secondary level 
parent activities. 

Based on K-3 program evaluation findings, it 
stems prudent to point out that any initiatives should 
first take into consideration the level of parental 
support for public instruction since garnering support 
appears to be a necessary prerequisite for parent 
involvement. 



•••And Staff Training? 

At-risk pilot sites must have the **right" people for 
programs to succeed-those with appropriate 
training and commitment to work with at-risk 
youth* 

Evaluation data on staff services make a strong 
case for drawing the conclusion that quality and 
commitment of staff are key aspects of program 
success. Yet data also suggest that pre-service and in- 
service training often fail to prepare staff for the 
challenge of working with at-risk populations. Pro- 
gram personnel recommend that pre-service training 
include more and earlier practical teaching exper- 
iences in diverse settings, including those with at-risk 
populations, and that students be encouraged to exit 
undergnuluate programs with ESL certification. 
Internships, mentoring programs with master teach- 
ers, and five-year undergraduate programs are 
additional options for improving pre-service pro- 



grams. Other district recommendations include more 
collaboration and closer linkages between schools and 
universities, and greater input in establishing teacher 
training requirements. 

Quality on-site in-service training is often diffi- 
cult and costly to provide. Making better use of 
available communication technologies could alleviate 
some of these problems, especially in rural and 
reservation area. Suggested incentives for promoting 
professional development include: giving teachers 
control of resources at the building level, paying for 
college courses with the stipulation that teachers stay 
with the district for a designated number of rs, 
providing stipends for teachers who fulfill a staff 
development function in the school, and paying 
teachers to attrad training offered during the summer. 

Staff training-both pre-service and in-service-is 
an area in need of state and local attention. In 
particular, strategies for providing training in more 
isolated districts need to be explored further. 

Quality of Implementation 

Program implementation issues are key factors 
affecting the likelihood of program success. 

The issue of "quality of implementation" was 
addressed in several ways. Predominiintly, primary 
and secondary staff were surveyed rej^arding various 
aspects of program implementation. These aspects 
were identified by program directors as elements that 
they felt either contributed or constituted a barrier to 
the successful implementation of their programs. 

Of fifteen aspects included on the staff survey, 
primary and secondary level staff shared six key 

concerns: 

• lack of an integrated school-district plan for 
meeting needs of at*risk students; 

• lack of alignmrat betwe^ philosophies toward 
at-risk students; 

• poor communication regarding the at-risk pro- 
gram; 

• poor pre-service staff training with respect to at- 
risk issues; 

• poor in-service staff training with respect to at- 
risk issues; and, 

• lack of school and community collaboration. 
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Planning issues were subject to heavy criticism 
in some districts. Some staff and school board 
members said their districts did not react to problems 
until threatened with a crisis. Others were character- 
ized as having no master plan, stating that their 
programs lacked focus and directinn, and that plan- 
ning was slipshod. 

• Said one staff member: "...the program has 
had no direction... [it] is in limbo.../ Regarding 
district management, another teacher said, 
*"n.dy're reinventing the wheel without consult- 
ing us first." • Stated an exasperated teacher: 
"It's hard to tell if the program is woiking when 
it changes every year. " 

In some districts, poor program management was 
seen as contributing to poor planning, prompting staff 
to call for better administrative support, guidance, 
and direction. Staff in other districts indicated that 
their programs had clarified goals and improved 
leadership during the past year. These factors had 
helped focus their at-risk programs and eliminate 
confusion and cross-purposes, staff said. Not surpris- 
ingly, stoff generally perceived that effective pro- 
grams had good leadership. 

Another key area oi u/ac«ro involves lack of 
stqff commkjtlcation and links within schools and 
districts. For example, sUff at sonie schools felt that 
teachers and administrators were weil informed about 
their at-risk program components; others felt the 
opposite was true. They recommended better formal 
and informal contacts between program staff, non- 
program teachers, and administrators. 

Yet, several staff interviewed indicated that 
overall district communication had improved as a 
result of the at-risk programs. Group planning efforts 
had pulled people together. 

• Said one teacher: "We are no longer just a 
staff of individual teachers... there is a feeling of 
being a group." Said another teacher: "There is 
a team spirit here.. ..a pride in improving the 
school.... We understand what we have to do." 

Several programs were criticized for late Imple- 
mentation and slow progress in effecting changes. 
Also, some staff bridled under forced classroom 
reforms "from the top" that did not have their input 
or support, even though these same staff admitted 
that refonns were needed. The notion of systemic 
reform was a common thread throughout the inter- 



views. Although many respondents said that more 
reform was needed, several staff and parents indicat- 
ed that great strides had been made already. 

• Said a reservation teacher: "Prior to at-risk 
funding, we had the attitude that, 'these kids 
can't fit into the system.* Now we are asking, 
'How can we change the system to fit the kids?' " 

Particularly at the 7-12 level, interviewees called 
for better linkages between discrete program compo- 
nentSf between programs and schools/districts^ and 
between programs and the community. Several 
respondents noted a lack of follow-up on students 
making the transition from junior high to high school, 
and from alternative programs to mainstream pro- 
grams. With respect to program-community linkages, 
staff from some urban districts reported improvixl 
conmiunity links as a result of at-risk programs. 
Examples of good linkages included job placement 
programs and family support services linked to sociai 
service agencies. In contrast, establishing good 
community linkages proved problematic for rural and 
reservation districts. 

• Said one reservation staff member: "Kids fall 
through the cracks without contacts with outside 
agencies. " 

As evident in the preceding discussion, several 
persistent barriers to success relate, directly or 
indirectly, to leadership and program management. 
There appears to be a strong link between unstable 
leadership, problems with program implementation, 
and poor communication. 

Investigating this link, Morrison Institute exam- 
ined the extent of administrative staff turnover among 
phase I sites since they began in FY 1988-89. Table 
10 shows the results of this investigation and indi- 
cates that more rural and reservation programs have 
lost their program directors compared to urban 
programs. Moreover, more school and district 
administratora (e.g. , principals, superintendents) have 
lef^ reservation schools than rural. Table 10 shows 
that, overall, there has been greater than a 50 percent 
turnover in key program staff and/or administration 
since the beginning of the programs-almost 70 
percent among 7-12 programs. 

High rates of key personnel turnover are cause 
for concern-particularly in the more isolated atid 
rural programs. Strategies to reduce turnover should 
be developed in all programs. 
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Table 10. Pkase I Al-RUk Protrams: Admmislnitif e Tnniof er^ 


Protraina (by Regioii) 


Al-Rtsk ProjiBcl Director 


District/School Admimstratioa 


Urban (8 prognmi) 
iwo: Kunu \f prognmi; 

ReiervaUon (7 programs) 

TOTAL (22 prog nuns) 


2 out of 8 25% 

4nulnf7 ^7* 

4 out of 7 57% 
10 out of 22 46% 


4 out of 8 50% 

4 out of 7 57% 

5 out of 7 71% 

13 out of 22 59% 


Urban (5 programi) 
7-12: Rural (4 programi) 

Reservation (4 programs) 

TOTAL (13 progruns) 


2 out of 5 40% 

3 out of 4 75% 

4 out of 4 100% 

9 out of 13 69% 


2 out of 5 40% 

3 out of 4 75% 

4 out of 4 100% 

9 out of 13 69% 


^ Turnover dau werv extracted from Morrison Institute formative and summative evaluation ifepoits: September 1990; January 1991; 
and June 1991. 



Research supports the relation found in this study 
between "effective schools" and implementation 
patterns. One example is a 1988 evaluation of a 
Gilifomia school reform initiative wherein "high 
gain** schools were noted to have "implementation 
patterns" associated with factors including: clear and 
consistent district reform visions...; more active use 
of... implementation plans; stronger iDq>lementation 
coordination between the school and ths district...; 
greater use of initial training; active administrator 
pressure and monitoring; substantially more on-going 
assistance, both from district and school leaders; on- 
going administrative commitment and leadership; and 
tight coupling between schools and their districts 
(Odden and Marsh in Hannaway and Crowson, p.5S). 

Preliminary comparisons^ of site evaluations, 
staff perceptions, and outcome data corroborate the 
notion that successful sites do, in fact, have a clearer 
vision of their at-risk programs, better conununica- 
tion and involvement at all levels, high expectations, 
teacher conunitment, and strong and stable program 
leadership. 

Specifically, effective communication at every 
level of the organization is essential for successful 
program implementation: when communication is 
lacking or inadequate, programs suffer. Conmiunica- 
tion, including the active participation of everyone 
who will be affected by an organizational change, 
needs to be initiated early in the change process so 
that changes are not initiated in a top-down fashion. 
Teachers want to be involved in program planning 
and decision-making activities, not just in implement- 
ing programs, and they want time to participate in 
these activities. New programs must be aligned with 
a well-articulated and shared district mission that has 



been locally defmed through a participatory process. 

In addition, schools and social service agencies 
must collaborate if programs are to effectively serve 
at-risk students. Because of the extreme nature of the 
social and emotional needs of at-risk students, provid- 
ing social services has become a dK facto function of 
the schools. Because urban, rural, and reservation 
programs exist in such different contexts and environ- 
ments, local collaboration is believed to be the most 
effective means of planning how to deliver services. 
Social services are most desirable when they are 
based at the school site and provided by qualified 
social service staff; however, teachers need training 
on how to work with social service providers. By 
moving seivices closer to the students, social services 
will also be more readily accessible to their families. 

Strong and stable leadership and administrative 
support are necessary for programs to succeed: lack 
of this support has been an impediment for many 
programs. One problem with school leadership has 
been extremely high administrative turnover. When 
new administrators are placed in programs every 
year, they bring their own personal goals, beliefs, 
and directions. Often they have not been provided 
Nvith historical Ic jwledge of the programs for whicli 
they are responsible, and usually they had no involve- 
ment in program planning. In some instances, the 
only program continuity has been provided by a 
stable teaching staff, who tend to become cynical 
watching administrators come and go. Turnover of 
program leaders has been a concern for nearly all 
programs, but has been especially severe in reserva- 
tion programs. An incentive structure to create 
stability at the administrative level should be thor- 
oughly explored. 
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Several districts that are **ahead of the game** 
began to address at-risk issues prior to H.B. 2217 
(1988). When these districts received additional 
funding, they had a clear idea of what kinds of 
programs and activities were needed to supplement 
their district efforts. At-risk programs were designed 
to meet specific needs for particular children, and 
greater efforts were made to integrate these services 
within a **totaI delivery system." In contra/it, Morri- 
son Institute fvaluators reported some districts* 
struggles to implement "top-down** programs with ill- 
conceived objectives, lacking any integration with 
overall district or school initiatives. As a case in 
point, one district showing the least gains in ITBS 
scores is one that has experienced considerable 
political conflict between the school board, district/ 
school administration, program administration, and 
teaching and support staff. 

Colleaiw ly, these findings suggest the need to 
create a "school climate" conducive to program 
success. Moreover, an argument can be made in 
support of preliminary program planning, with 
technical assistance if needed, to involve stcjj arJ 
administrators in developing a comprehensive plan 
incorporating staff training, school-community part- 
nerships, and on-going monitoring and evaluation. 

At the 7-12 level in particular, the issue of philo- 
sophical difTerences among stafT regarding at-risk 
students and programs needs to be more systemat- 
ically addressed. 

Philosofl'cal differences among staff in their 
attitudes toward at-risk teene and programs are very 
pronounced at the 7-12 level. These differences are 
evidenced by numerous descriptive and statistical 
differences among 7-12 staff in all data sets» and in 
staff surv^ey responses in particular. 

Differences between program and non-program 
staff are most troubling. It was anticipated that 
program staff would be more positive than non- 
progmm staff regarding program efforts; however, it 
was not anticipated that one of every ten staff mem- 
bers surveyed had no knowledge of their distria 's 
pro^/amsfor at-risk youth. In addition, many non- 
program staff expressed opinions that were unsympa- 
thetic regarding at-risk youth and against at-risk 
programs (e.g., ** At-risk kids are simply trouble- 
makers looking for easy ways out;** **Our [programs] 
and policies are a joke;** **It should be called: How to 
earn a credit in 3 easy minutesi **). 



There is more consensus among staff at sites 
which implenoented self-contained programs (e.e. 
off-site alternative schools). In addition, a grea^. 
percentage of students in these programs said they 
felt "respected** as human beings, despite their 
reputations. Notably, more "holistic" clianges in 
attitudes and behaviors were observed among students 
in these delivery systems. Many at-risk teens S£^id 
they were more comfortable in these settings because 
they didn*t feel as "different." 

In contrast, more staff discrepancies were docu- 
mented in districts inQ)lementing more discrete 
interventions (e.g., one class a day). Program staff 
felt confident that they were making progress '«yith 
their pupils; among all staff, however, there was 
more diversity in attitudes and little consensus regard- 
ing "what works** for at-risk teens. It is obvious that 
within such delivery systems, at-risk pupils interface 
with non-program staff members \ot a significant 
proportion of the day. Perhaps it is because some 
st^rf members have negative opinions of at-risk 
students that students in discrete interventions express 
fewer changes in attitudes and behaviors. 

Research has suggested that successful dropout 
programs create a school climate that is secure, safe, 
and comfortable. As Hamby states: "The emotional 
atmosphere must be positive so that students will not 
fear a loss of self-esteem by being there** (1989, p. 
83). To the extent that philosophical differences 
among 7-12 staff reflect their behavio- tc vard at-risk 
students and programs, students undoubtedly receive 
"mixed messages." The evaluation of Arizona's at- 
risk sites demonstrates that a cohesive philosophy 
aniong staff in the more holistic programs is associ- 
ated with a greater number of positive attitudinal 
outcomes among students. Programs in which staff 
have notable philosophical differences are associated 
with fewer changes in stuJents* attitudes. 

At the 7-/2 level, greater efforts should be 
implemented to achieve consensus regarding at-risk 
youth and appropriate interventions. 

On The Whole? Programs Have 
Produced Positive Results 

All evidence suggests that the at-risk pilot pro- 
grams, as a whole, have had a positive impact on 
the lives of at-risk students and parents* 

Arizona's K-3 at-risk pilot programs have imple- 
mented a number of educational alternatives to help 
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children at risk of academic failure. Since their 
implementation, there has beoi a steady decrease in 
the number of children retained within pilot sites. 
Additionally, attendance has been on the rise and net 
ITBS gains have been witnessed in language and 
reading, with third grade students exiting at higher 
skill levels than their predecessors. Consistently, staff 
and parents have praised their schooPs efforts to give 
more individualized attention to students and parents 
alike. 

The 7-12 at-risk programs continue to embrace 
the challMige of woridng with teens who are well- 
acquainted with school faUure. During FY 1990-91 
alone, nine out of every ten program participants 
reportedly remained in school or graduated. Atten- 
dance rose for the first time since the inc<^tion of the 
programs. Standardized test gains were made in lang- 
uage and math-with twelfth grade students exiting at 
higher skill levels than their predecessors in these 
areas. Staff, students, and parmts have attributed a 
number of attitudinal and behavioral changes to 
program participation, often crediting helpftil and 
caring staff with providing more individual attention. 
Staff and students, particularly at the junior high 
school grades, noted increased parent involvement 
and participation in the programs. 

For both primary and secondary programs, staff 
have increased their awareness of appropriate instruc- 
tional strategies for working with at-risk (and all) 
youngsters. Schools have received much-needed 
funding to add staff and purchase supplies and 
materi^s to enrich their students^ educational experi- 
ences. Greater numbers of parents have begun to play 
a role lu the educational system-some coming to 
school for the first time since their own adolescence. 
And, there has been unprecedrated accountability 
among these programs. 

Unfortunately, schools cannot make "at-riskness" 
disappear b«^use students are at-risk for reasons that 
are largely environmental and outside the scope of a 
schooPs control There are still barriers to overcome 
and progress to be made. For example, K-3 children 
need to exhibit greater skills in all areas, particularly 
math, to advance at grade level. Schools need to 
address philosophical differences regarding retention 
and ** social promotion." 

Cleariy, at-risk teens need to exhibit greater 
skills in all areas, and reading in particular. But more 
important perhaps, schools need to address philosoph- 
ical issues such as: the comparability of curriculum 



betweem * traditional* and "alternative" courses of 
study and desirable types of delivery systems for at- 
risk youth. 

At all levels, more parents of at-risk pupils need 
to support and become involved in the educational 
process, li^chools need to establish more collaborative 
partnerships with social service agencies, and make 
greater efforts to reach out to parents and community 
members. Staff must continually upgrade their skills 
and keep abreast of the latest research and technology 
that will enhance their abilities to provide individual- 
ized instruction. Especially at the secondary level, 
staff training needs to target non-program staff as 
well program staff. Also, more staff are needed- 
instructors, counselors, and social workers as well. 

At-risk students have shown progress in the Ari- 
zona At'Risk Pilot Project. Additional progress is 
dependent on continued support at the state and local 
levels. 

What Other Findings Are Impor- 
tant? 

Student attrition is a valid concern amonp at-risk 
programs. 

From the 3958 primary level students targeted 
for tracking in FY 1989-90, 2814 remained at the end 
of FY 1990-91 (71 percent). Three out of every 10 
students were unable to be tracked longitudinally. 
Excessive mobility is a substantial concern for several 
districts, primarily in the urban and rural areas. In 
three districts, studrat attrition was over SO percent. 

For 1307 secondary level students targeted for 
tracking, 320-or 25 percent of the original group- 
remained two years later. Of the 75 percrat who left 
the cohort, 10 percent graduated or received a 
G.E.D.; only 15 percent were known dropouts. The 
whereabouts of the other 50 percent were unknown 
either because students transferred or no records were 
kept. Student attrition, particularly during the summer 
months, affected accurate recordkeeping and report- 
ing of student outcomes. Poor records, in turn, made 
it difficult to understand thoroughly the nature of 
student transience versus dropouts at the upper grade 
levels. 

Program may not be able to make much of a differ- 
ence if students do not remain in the same school. 
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Consistent descriptive and statistical difTerences 
suggest that at-risk students, programs, and stafT 
vary regionally, and in somewhat difTerent pat- 
terns at the K-3 and 7-12 levels. 

Arizona's reservation at-risk K-3 children are 
affected by more at-risk factors than un children in 
other regions. Reservation students appeu to reflect 
"at-riskness" more m the basis of life circumstances 
over which they have little control than because of 
behavioral problems. More 7-12 reservation studmts 
indicate that they have responsibilities that mterfere 
with school work and live in homes that do not have 
year-round electricity, plumbing, and/or telephones. 
Most disturbing, more older reservation pupils report 
feeling unsafe and/or unprotected at home. In fact, a 
majority of program directors estimated that three out 
of every four reservation pupils are from an abusive 
home environment. 

ITBS scores for the K-3 cohort group suggest 
that reservation at-risk pupils score lower on these 
tests than do their rural and urban peers; likewise, 
absentee rates at both program levels are consistently 
higher, ^rogram sUff turnover is higher than in other 
programs, and staff working in reservation districts 
consistently rate the effectiveness of services (for 
students, parents, and stoff) and outcomes less 
positively than do their colleagues. 

The isolation of these districts compounds their 
problems. Parait involvement is difficult, given that 
many parents do not have telephones or access to 
transportation. Unemployment may also be a factor 
contributing to a lack of parent involvement. Staff 
qualifications pose particular problems, both in 
recruiting qualified sUff and kecking them once 
trained. Providing appropriate training is also prob- 
lematic since it is difficult and costly to recruit 
qualified trainers to provide on-site in-service; it is 
equally demanding and costly to send sUff to other 
locations for training. Social service linkages are hard 
to esUblish because of the tremendou demands on 
those services and the tribal infrastructare governing 
most of tl services. 

Rural at-risk students in Arizona live between 
two worlds. They have the isolation of small commu- 
nities, yet access and exposure to metropolitan areas. 
In virtually every K-3 data set, rural at-risk children 
fall in the middle of the extremes represented by 
reservation and urban children. Rural children appear 
at-risk primarily due to povoirty and the conditions 
Uiat accompany being poor-a lack of education- 
al/reading materials, substandard living conditions, 



ERIC 



24 PnweffiU StoHes, Positive ReniUs 



parents who work and therefore are not home after 
S(ihool contributing to the latch-key status of many 
rural children. 

At-risk youth in the 7-12 rural pilot programs 
represent a naore mobile population and a greater 
percentage of recent immigrants to the United States. 
It is not surprising, given this, that more at-risk rural 
youth speak a language other than English at home 
and have language difficulties in school. They tend 
nor to be involved in any school/community activi- 
ties, and have a history of academic failure (with one 
or more grade retentions in their elementary years). 
Relatively more rural youth report using drugs and/or 
alcohol on a weekly basis. 

As with reservation districte, rural isolation 
appears to exacerbate low parent involvement and 
difficulties recruiting and keeping qualified staff and 
administrators. Unlike reservation areas, however, 
rural communities are increasingly becoming the 
"crossroads* linking metropolitan areas. Therefore, 
rural areas are being increasingly exposed to prob- 
lems more symptomatic of urban area&. For example, 
one rural community was described as the "drug 
connection* between Tucson and Phoenix, and one 
at-risk thirt grade student was "busted" for pushing 
drugs on behalf of his gang member parents. 

Rural K-3 staff perceive moderate success in 
their programs. In contrast, rural 7-12 staff and stu- 
dente are the most positive of all regions. And 
students in the 7-12 programs, which are largely 
"Ljlistic* in their approach to at-risk pupils, are more 
likely to attribute their own changes in behaviors and 
attitudes to program participation. Moreover, rural 7- 
12 program students are out-performing their peers 
academically, unlike their K-3 counterparts. 

Urban/suburban programs portray yet another 
picture of at-riskness. At the K-3 level, a profile of 
poverty and neglect emerges. The effecte of parental 
substance abuse and abusive home environments are 
particularly pronounced for urban children, and this 
finding suggeste that many urban children are most 
at-risk whM their home environmente are "dysfunc- 
tional.* Urban K-3 children are less likely to remain 
in the same school than the children in the other 
regions. 

At the 7-12 level, urban youth are characterized 
by the most at-risk indicators. Urban youth represent 
a broader ethnic spectrum than youth in other regions 
and tend to be from the least "nuclear family-orient* 
ed" households. More urban youth have children, 



have a sibling who has dropped out of school, have 
dropped out themselves, indicate poor health, have 
seriously considered or attempted suicide, skip 
school, been suspended or expelled, been convicted 
of a crime, and have parents who are neither support- 
ive of nor involved in their education. 

K-3 urban staff consistently express more posi- 
tive attitudes about their efforts and accomplishments 
than do their colleagues in rural and reservation 
areas. Students fimction higher than children in other 
regions, and show more academic progress-at least 
for those children who remain in the system long 
enough to track. Urban staff are more stable than 
staff in other regions, and it is easier to offer them 
training given the proximity to universities and 
community colleges. 

In contrast to Iheir K-3 colleague, urban 7-12 
staff are more negative regarding program imple- 
mentation and more reserved in their assessment of 
program outcomes. Students in grades 7-12 are not 
functioning higher than their peers, but they are 
performing on a par with them. Notably, urban 
students, more than their rural and reservation peers, 
view program staff as helpful and caring, and credit 
their programs with involving their parents more with 
their education, inq)roving their grades, helping them 
stay in school, helping f^^.m set future goals, and 
increasing their self-esteem. 

Overall, these findings strongly suggest the need 
for local autonomy in program planning, implementa- 
tion, and evaluation so that the unique aspeas of at- 
risk student populations may be appropriately ad- 
dressed. 

Consistent descriptive and statistical differences 
suggest that at-rLsk youth in grades 7-8 differ from 
their 9-12 peers. 

The most noteworthy finding regarding 7-8 grade 
pilot program students is: overall, they exhibit fewer 
indicators of "at-riskness" than their 9-12 peers. 

The image that emerges from a collation of all 
data is that these students are truly at a stage in their 
development where they could *go either way." A 
majority of at-risk indicators for middle school 
snidents suggest emotional-behavioral problems (not 
involved, drug/alcohol use, suspension, juvenile 
delinquency). It may be of practical significance that 
more of these indicators are potentially predictive of 
academic success among these students than for high 



school students. This implies that interventions have 
a better chance of "preventing* school failure. 

The interventions that have been studied primari- 
ly involve supplemental services, although there are 
several school-within-school models. Notably, middle 
school students responded most positively to social 
support: these kids need people to care about them. 
Moreover, survey respondents in 7-8 programs are in 
greater agreement that program participation has 
prompted their parents to help them more with 
schoolwork, and that programs have provided more 
opportunities for parents to become involved. 

Evaluation findings have n'^t provided definitive 
answers regarding successful it^^^rventions for junior 
high students; however, there are some components 
perceived as "making a difference" in the eyes of 
students. Urban students respond to support groups 
and a self-contained class that provides academic and 
social support as well as opportunities for work 
experience. Rural pupils respond to school-within- 
school settings, which allow for more individualized 
attention and self-paced curriculum. And, reservation 
youth respond to vocational activities that incoix>orate 
applied academics and social support. 

More intervention programs are desirable at 
grades 7-8 because at-risk behaviors are not well- 
defined as yet. Programs may, therefore, have more 
impact in "curbing " the further development of at-risk 
behaviors among early adolescents. However, such 
programs should be implemented by qualified staff 
who are committed to working with this challenging 
population. 

The label "at-risk** has, for many, n^ative conno- 
tations. 

Many pilot district personnel have expressed a 
dislike for the label "at-risk" because it is viewed as 
focusing on "the child as the problem." Educational 
leaders are increasingly advocating alternatives to the 
"at risk" label precisely because the label itself may 
connote underachievement and/or contribute to low- 
ered eT.pectations. For example. Levin (Hopfenberg 
et. al., 1990) has adopted the term "accelerated 
schools" to shift the emphasis away from the "child 
as the problem" to the "school as solution." 

Dislike for the term goes beyond a semantic 
d^^ate: it has had visible consequences in terms of 
program implementation. For example, the labeling 
of funds, programs, and students as at-risk has 
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contributed to poor communication within districts 
and between districts and communities. In some 
cases, there has been a reluctance to publicize that a 
district is the recipient of "at risk funds'* for fear that 
parents, community members, and staff may find the 
term offensive. Many districts created their own 
program acronyms and were successful in conmiuni- 
eating the goals and objectives of their at-risk pro<- 
grams; yet many others did not. 

The label has served a useful purpose in focusing 
attention on students at risk of academic failure 
because of poor environmental conditions, and iu 
creating resources targeted toward these students. But 
the time is ripe for the state to provide leadership by 
adopting terminology that shifts the emphasis from 
"problem students'* to school solutions. 

There should be some consideration of coining a 
more positive label than 'at risk " 

What About The State Role in 
the PUot Project? 

The scope of this project was extensive since it 
included the monitoring and evaluation of programs 
within over one-quarter of Arizona^s most "at-risk" 
districts. Much has been learned by the evaluators, 
by the pilot sites, and by the Arizona Dq)artment of 
Education, regarding the arduous task of monitoring 
and evaluating long-term, large-scale programs. In 
retrospect, many "systemic components" necessary to 
complete the project in the most efficient and effec- 
tive manner did not exist at the time the pilot was 
initiated-streamlined state "request for proposal" 
(RFP) procedures, a Department of Education infra- 
structure for program monitoring, valid performance- 
based student outcomes measures, and a funding 
cycle that encourages and allows long-term planning. 

Adequate program planning was not evident in a 
majority of district proposals; however, adequate 
time for planning was not available prior to 
receiving program funds. 

Initial H.B. 2217 (1988) ftmds were appropriated 
in June 1988 for use during the school year beginning 
August 1988. However, prior to the distribution of 
funds it was necessary for the Arizona Department of 
Education (ADE) to develop an RFP process-a 
process taking several months. Once procedures were 
completed, districts had about six weeks to develop 
their proposals. A lack of local planning and/or grant 



writing expertise coupled with the short iime frame 
resulted in vecy little "creative" planning. Further, 
while the RFP required the development of specific 
program objectives, most proposals included objec- 
tives that were nebulous, unrealistic, and uimiea- 
surable. Primarily because of time constraints, 
proposals were accepted despite their poor quality, 
and funding was distributed. Generally, timing and 
planning concerns continued throughout the project. 

A lack of adequate long-term planning has had 
several consequences. Some programs have devel- 
oped in a "piecemeal" fashion, lacking integration 
within the district/school. Other prograuLs have failed 
to involve personnel in planning who are charged 
with implementing the programs. Such "top-dowrn" 
initiatives have often been difficult to implement due 
to lack of faculty support. Initial limitations in the 
proposals (e.g., regarding objectives) were never 
adequately addressed in some cases, resulting in a 
lack of local program focus and systematic evalua- 
tion. 

Why is planning important? Evaluation data 
reveal that sites that had developed more compiehen* 
sive plans based upon extensive input from staff did 
demonstrate greater outcomes. District and school 
personnel have acknowledged repeatedly the impor- 
tance of initial planning and on-going review and 
adjustments. Those who conduct^ self-evaluations 
were better aware of program adjustments that 
needed to be made, and produced better results. 

District and school personnel have acknowledged 
that although planning is important, it frequently does 
not occur without some outside requirements or 
"pressure." Further, maviy personnel do not like to 
invest time in planning without some guarantee that 
their time will be worth the effort (i.e., the grant 
money will be available). Finally, many districts 
simply need technical assistance in long-term plan- 
ning. Although the movement in Arizona and across 
the nation is away from state "requirements," even 
the Governor's Task Force for Educational Reform 
has recommended that schools develop plans prior to 
the receipt of at-risk funds. 

Districts and/or schools should be required to 
develop comprehensive program plans. Adequate time 
(3-6 months) and technical assistance from the state 
department and/or planning monies is/are essential. 
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The current fimding cycle, dependent upon annual 
appropriations rather than formula funding, does 
not promote long-term planning and effective 
programming. 

Late adjoumments of recent legislative sessions 
have resulted in the authorization of funds occurring 
only weeks prior to the beginning of the next school 
year. This time frame has effectively curbed dis- 
trict/school efforts to create long-range plans involv- 
ing at-risk monies. Beyond influencing planning, 
however, the funding cycle has also affected program 
implementation. 

Once funds were authorized, the flow of paper- 
work between agencies resulted in funding delays-up 
to six and seven months in some cases. Some smaller 
districts could not afford to count on the fact that "the 
check is in the mail;" funding delays sometimes 
prevented services from being offered and, ulti- 
inately, affected the quantity and quality of program 
outcomes available for study, Although greater 
efficiency m processing paperwork could alleviate 
some problems, a more fundamental issue centers on 
the annual funding cycle. Used as a funding mecha- 
nism, annual appropriations simply are not conducive 
to long-term planning and quality implementation. 

The alternative is to create permanent funding for 
at-risk programs through formula funding. However, 
unlike most existmg formula funds that are "block 
grants" (i.e., unrestricted funds), mterviews with 
program staff have repeatedly revealed that "targeted" 
funding for at-risk students is preferable. Unless 
funding is targeted, districts report, there are too 
many demands on a their budgets and not enough 
advocates for at-risk students when it comes to 
budget decisions. Pilot districts want the accountabili- 
ty associated with targeted funding^ but, they do not 
want extensive restrictions on the use of these funds. 

There is a need to establish permanent JUnding 
for at-risk programs, to ensure program continuity. 
Direct formula funding targeted"* toward at-risk 
programs is a preferred finding mechanism. 

The identification of district/schools as ^at-risk'* 
and the determination of grant amounts were 
appropriate for a competitive grant process; 
however, new mechanisms need to be created if 
permanent formula funding is utilized. 

Consideration needs to be given to the criteria 
used as part of an "at-risk weight." Several weights 



currently provide additional funds for students who 
are identified as having certain characteristics (e.g., 
iiiiz^dicapping condition, LEP). The definitional 
characteristics for these weights are very specific in 
)rder to avoid labeling students for funding purposes. 
^At-risk, " however, is a term not easily defined smce 
theie are a variety of reasons a student may be at- 
risk. Unfortunately, reliable and comparable dat;» on 
most at-risk indicators are currently not available. 
Moreover, it is important not to base funding on 
indicators over which districts/schools have some 
control (e.g., low test scores, absenteeism). If these 
factors are utilized, then improvements may result in 
a funding loss. 

As a solution, indicators which cannot be manip- 
ulated and which serve as a "proxy" for at-riskness 
are bemg used in several states. New Jersey and 
Kentucky are using poverty, as measured by eligibili- 
ty for federal free lunch programs, as their at-risk 
weight proxy. Poverty is frequently chosen because 
of its underlying linkages to at-riskness^ This does 
not mean that only poor studrats can be served with 
the at-risk weight funds, but mstead it provides a 
mechanism for providing additional fundmg to the 
schools. Once tiie funding is received by the dis- 
trict/school, they are allowed to serve those students 
they believe to be at-risk. 

Within Arizona, preliminary discussions with 
state school finance experts reveal that three at-risk 
indicators have established databases and represent 
factors over which district": have little control: pover- 
ty, mobility, and LEP. Since the state already partial- 
ly funds a LEP weight, the current thinking is that 
the other two factors would be used to establish an 
at-risk v/eight-poverty and mobility. 

Two options for the measurement of poverty 
appear to be available and are bemg analyzed. One 
option— using census data (similar to federal Chapter 
1 funding)--poses several problems: 1) necessary data 
Will not be available until at least 1993, 2) data will 
not be available at the school-level, and 3) the daU- 
base is updated only once every decade. The second 
option is to use the number of eligible students for 
the federal free lunch program. This too has prob- 
lems since many high schools and some elementary 
schools do not offer such a program. In addition, the 
percentage of families that actually apply are fewer 
than those who are eligible. However, the advantage 
is that these data are available at the school-level and 
are updated annually. Contmued work on the me- 
chanics of funding is underway. 
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Finally, consideration must be given to an 
"adequate" level of funding. For the pilot grant 
project, districts/schools were allowed to request any 
amount within a certain range. If an at-risk weight is 
utilized, however, a specific amount needs to be 
placed in the formula. This amounf should be no less 
than the average expended per student by these pilot 
programs (i.e., $227 for K-3 and $251 for 7-12). In 
addition, dq)endent upon the expectations for train- 
ing, parental involvement and social service coordina- 
tion, the amount should be higher than Che average. 
For example. Levin (1989), an economist from 
Stanford University, estimates at-risk funding should 
be about half again as much as is spent on nondisad- 
vantaged students (e.g., approximately $2,000). In 
Kentucky, $528 per free lunch student was provided 
during FY 1990-91 for both general programming 
and for Family Resource Center support. Since nearly 
one-third of Arizona's students qualify for free lunch 
status, these amounts may not be realistic; however, 
they are offered as a starting point for discussion. 

Additional funding (over the base weight amount) 
should be provided to small and rural schools, and 
for programs wishing to develop more comprehensive 
services such as alternative schools. A minimum 
amount (e.g. , $5,000-$ 10,000) should also be consid- 
ered for all except the very smallest of schools. 

Unique among 7-12 programs, the Pima County 
Detention Center served an important role as a 
dropout "interdiction" program. Students were 
reenrolled who had dropped out of school and poten- 
tial dropouts were kept on school rosters after being 
placed in the detention facility. Funding should be 
considered for these types of educational programs. 

An at-risk weight based upon poverty and mobil- 
ity indicators would provide a mechanism for direct- 
ing funds into a district/school; local decisions would 
then be made at that point as to which students are to 
be served. Additional funding should also be consid- 
ered for small and rural schools, more comprehensive 
services, and detention center programs. 

Arizona Department of Education technical assis- 
tance efforts contributed to project outcomes; 
however, the current state-level infrastructure for 
monitoring efforts needs continued refinements. 

The Arizona Department of Education contracted 
with Morrison Institute to conduct the evaluation 
study, but retained the functions of program monitor- 
ing and technical assistance. As a whole, the pilot 
programs responded positively to the available 



technical assistance^ The greatest concern was that 
"more" was needed, particularly in reference to the 
initial grant writing process and on-going program 
refinements. Also, because many of the at-risk 
programs are in reservation and rural areas, these 
sites do not have easy access to university training or 
staff support. The on-site visits and state-wide meet- 
ings/conferences were viewed as extremely helpful. 

Program monitoring also proved to enhance 
program success; however, improvements to this 
process need to occur. There was initial uncertainty 
about the role of the external evaluator and ADE in 
reference to annual reapprovals. Indeed, some of the 
information gathered by the external evaluators was 
also requested by ADE and vice versa. Although 
individual evaluation reports prepared by Morrison 
Institute were available to ADE, this information was 
used inconsistently as part of the reapproval process. 

Most important, however, was a perception by 
districts that there were no real "consequences" for 
failing to implement activities outlined in their 
proposals. Many districts complied with evaluation 
requirements in an untimely manner, resulting in 
delays of the external evaluation. In the two and one 
half years of Morrison Institute's involvement with 
the project, only one deadline was met by all dis- 
tricts-when ADE "threatened" to vwthhold annual 
reapprovals. Although several programs were placed 
on probation, most districts were conditioned to 
believe that negative sanctions would not be enforced. 

Historically, ADE efforts in reference to state- 
funded programs have focused primarily on monitor- 
ing budgets, not programs. As a result, the necessary 
program monitoring infrastructure is still being 
developed. Further, it is difficult to provide both 
technical assistance (e.g., help a district in trouble) 
and enforce sanctions (e.g., withhold funding if 
improvement efforts are not being made). Perhaps 
these two tasks cannot be performed by the same 
entity. In several states, a separate "accountability" 
office has been established to address this concern. 
Within 'Arizona, the Governor's Task Force has 
recomn <ed that the Auditor General's Office take 
on the L. . of program monitoring. This separation of 
responsibilities should be given serious consideration. 

Findings suggest that expanded technical assis- 
tance be made available and that state monitoring 
continue. However, monitoring may need to be moved 
to a separate agency or department for the explicit 
purpose of ensuring quality compliance with funding 
requirements by enforcing sanctions when necessary. 
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Overalli the external evaluation process had a 
positive efTect on program implementation; there 
is, however, a need for greater emphasis on 
district self-evaluation/analysis. 

A majority of pilot districts indicated that the 
evaluation process ultimately benefitted the programs, 
although complying with such requirements was an 
extra burden on their staffs. Having an external 
evaluation prompted greater attention to implementa- 
tion processes, services provided, students served, 
and desired outcomes. District personnel, on the 
whole, felt the external evaluation provided greater 
accountability and found the information provided to 
them important-both as k means to validate their 
efforts and as input for program improvement and 
local decision-making. In addition, the external 
evaluation has resulted in a wealth of gwieral infor- 
mation for state policy makers. 

In efforts to determine the overall effectiveness 
of the toUl at-risk pilot project as well as of specific 
strategies, common data sets were collected to allow 
for individual program comparisons and aggregate 
analyses across all K-3 and all 7-12 programs. While 
this approach provided a wealth of data regarding the 
total project in a holistic sense, many of the unique 
characteristics and impacts of specific programs were 
Most" in the aggregate. Although districts were 
encouraged to collect and report self-evaluation data, 
few districts did so. Instead, they relied solely on the 
external evaluation as their feedback loop. Many 
programs did not, therefore, have their own unique 
data upon which to base refinement decisions. The 
external evaluation should not serve as a replacement 
for a systematic internal evaluation. Many districts 
acknowledged that they would have liked to conduct 
their own internal evaluations, but do not have the 
staff, time, or the expertise to do so. 

It appears that the external evaluation effort!; 
have resulted in positive benefits at b^th the local and 
state level; such evaluation efforts should continue to 
be supported, but with additional emphasis cn train- 
ing district personnel to conduct quality studies of 
their own. 

Valid measures of student outcomes and consistent 
recordkeeping and reporting mechanisms are 
lacking. 

The public is demanding the measurement and 
reporting of specific program outcomes. The develop- 
ment of appropriate assessment measures at the state 



level is highly desirable, particularly since many 
districts lack the expertise to define and measure 
program outcomes independently, i^ ^zona has 
jumped ahead of most states through the development 
of its Arizona Student Assessment Program (ASAP). 
Unfortunately, this program was not available for use 
during this evaluation study. Indeed, on-going diffi- 
culties experienced in defining common outcome 
measures (in addition to standardized tests) lends 
support for the expeditious completion of the new 
assessment program. 

Within this evaluation project, desired outcomes 
among programs were identif:-^d and categorized so 
that conunon data sets could be collected across 
districts. However, determining adequate measures of 
these outcomes proved to be extremely difficult. Lack 
of standardization existed among districts on variables 
such as absenteeism, dropout rate, and grade reten- 
tion. Most districts had never collected daU on parent 
involvement and staff training activities. Extensive 
efforts were necessary just to determine how r^any 
students, staff, and parenta were served, with even 
greater energy required to measure the impact of 
these services. Data reporting standards had to be 
designed and th<m "taught" to the districta. The 
resulte often included calculation errors, requiring a 
tedious and Iragthy verification process. Great gains 
in the measurement of program outcomes were 
achieved; further efforte to create comparable assess- 
ment measures (puch as ASAP) will serve to enhance 
future external evaluations in this state. 

Tht./e is a need for continued/expanded support 
for the development of more standardized outcome 
measures. Districts and/or schools are ready to be 
held accountable, hut most current assessment efforts 
and procedures are rudimentary at best and require 
continued state support and attention. 

RECOMMENDATIONS 

Many suggestions arc embedded in the previous 
sections of this report. This section synthesizes the 
findings in terms of key reconunendations. It is by no 
means a comprehensive listing, but is intended to 
highlight state-level actions that could fvrther the 
development of comprehensive programming for 
Arizona's studenta at risk. For the purpose of the 
recommendations, "state"* is used when both legisla- 
tive and Arizona Department of Education actions are 
encompassed within the recommendation. 
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1. The Arizona Department of Education (ADE) 
should create a single, comprehensive unit which 
supports and assists local at-risk initiatiyes. 

By streamlining state and federally-funded pro- 
gram at-risk related personnel (e.g., K-3 At-Risk, 7- 
12 At-Risk, LEP, Chapter 1, Migrant, substance 
abuse) into a single unit, the sUte can create the 
infrastructure and provide leadership to model and 
promote practices associated with successful program 
implementation at the local level. This is particularly 
needed in relation to "at-risk" districts and/or schools 
that do not have their ow , stable infirastnicture. 

• Develop a comprehensive plan for meeting 
the needs of at-risk populations. Examine 
programs, funding goals and expectations, re- 
quired paperwork, and existing accountability 
measures for the purpose of mtegrating these into 
a comprehensive plan. 

• Define general standards for local district/ 
school recipients of at-risk funds, including 
expectations for local comprehensive plans to 
specify linkages among related programs (e.g., 
at-risk and LEP). 

• Specify criteria and measures for program 
accountability tfiat meet federal and state re- 
quirements. Develop common criteria for non- 
test indicators (e.g. , absenteeism, retention) since 
disparities currently exist in local definitions and 
reporting. 

• Coordinate/consolidate program reporting 
functions with the explicit goal of reducing 
paperworic. 

• Design a computerized database and record- 
keeping system for compiling and analyzing 
outcome data (as determined by the comprehen- 
sive unit) and disseminate the technology state- 
wide. 

• Define and implement consequences for 
programs Uuit either do not complete require- 
ments or provide unusable information in 
meeting requirements to reinforce that the 
quality of progranuning, data collection, and 
reporting must be an integral part of compliance. 

• Coordinate technical assistance to at-risk 
populations/programs. 



2. The legislature should establish permanent 
funding mechanisms to support at-risk programs 
at all grade levels, provided that the Arizona 
Department of Education has created the infra- 
structure to handle funding requirements and 
ensure local accountability. 

At-risk youth have shown progress within the 
context of the Arizona At-Risk Pilot Project. Con- 
tinued support is required to serve additional students 
(e.g., grades 4-6) and allow programs to evolve and 
improve. Pilot project personnel have repeatedly ex- 
pressed that "targeted" formula funding is preferable 
to both block and competitive grant fimding. 

• Create an at-risk weight to provide basic 
targeted funding. Use factors such as poverty 
and mobility, as these indicators would provide 
a mechanism for directing funds into a district/ 
school; local decisions would then be made as to 
which students are to be served. 

• Provide a small and rural school supple- 
mental stipend, stipulating a base minimum. 
These schools typically have smaller enrollments 
that would limit an at-risk allocation based on 
formula funding, and therefore need additional 
resources to provide services as costly to imple- 
ment as in larger districts (e.g., paying an addi- 
tional teacher). 

• Fund educational services within county 
detention centers, using the Pima County Deten- 
tion Center program as a model. 

• Institute an "education venture fund" with 
a 5eparate request for proposal (RFP) process 
to encourage and reward innovative and compre- 
hensive programs such as Family Resource 
Centers or alternative schools that require greater 
resources than provided by formula funding. 
Require that proposals are submitted jointly by a 
local educational agency in collaboration with a 
local business partner such as a social service 
agency, association, or other organization. 

3. The state should adopt an alternative label to 
"at risk." 

The adoption of an alternative label associated 
with funding (e.g., Comprehensive At Eisk Educa- 
tion, or CARE) could get a lot of mileage in terms of 
creating a positive "state climate" for further program 
development. Although the at-risk" label has been 
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useful, it is geoermlly perceived as a negative term 
when applied to children, their parents, and districts. 

4. Local districts and/or schools should develop 
comprehensive plans, aligned with state standards, 
as a condition for initial at-risk funding and 
reapproval. 

Local autonomy is essential in creating appropri- 
ate programs to match the needs of the local popula- 
tion. Evidence from this evaluation has shown, 
however, that local programs based on district/school 
plans have been more effective than those without 
such plans. 

• Require that plans describe how services 
targetiiq( at-risk children are coordinated with 
related educational and social services. 

• Establish *^planning grants*^ and/or allow 
adequate time to assist local districts develop 
their comprehensive plans. Based on feedback 
from pilot districts, good planning that involves 
staff, parents, and/or community members, takes 
time— at least three to six months. 

• Provide individualized technical assistance 
upon request to facilitate the development of 
quality plans. 

5. The Arizona Department of Education's new 
^^comprehensive at-^risk education** unit should 
ensure that local plans are implemented* 

• Provide individualized technical assistance 
upon request to fadliiate the implementaOon of 
quality programs. 

• Designate vnthin ADE's comprehensive unit 
an **at*risk broker** who would link local progr- 
ams to an identified sUte-wide network of tech- 
nical assistance, and disseminate information 
about at-risk intervention strategies that have 
proven to be successful in model sites. 

• Monitor/audit programs annually at first, 
then on a two-three year cycle, to ensure 
progress toward locally-defined goals conmiensu- 
rate with state expectations. Consider separating 
this fimction from technical assistance. 

• Require districts to submit periodic self- 
evaluation reports (annually at first, then on 
a two-three year cycle). Program evaluation is 



essential for accountability and as a tool for 
program improvement. The state should develop 
model evaluation designs aligned with specific 
intervention strategies and other resources for 
use by district personnel. 

• Develop the expertise nt ADE and through- 
out a state-wide technical assistance network 
to review district/school self-evaluation docu- 
ments and comfHle quality outcome reports to 
assist in future dedsionnmaking. 

6. The Arizona Department of Education should 
use successful at-risk pilot sites to demonstrate 
**what works** for at-risk pupils. 

Pilot sites have invested four years in developing 
at-risk programs. Successful sites, and replicable 
programs (to be identified in Morrison Institute*s 
forthcoming "what works" report), have staff who are 
valuable resources for sharing their expertise with 
ADE and other districts. 

• Contract with at-risk educators in successful 
programs to act as consultants/mentors regard- 
ing "promising practices" for at-risk children and 
to provide peer training. 

• Subsidize training held **on-site^^ at these 
demonstration schools. 

7. The state should designate as its highest priority 
programs that specify improved language and 
literacy outcomes. 

Extensive efforts have been expended to evaluate 
"what works" for Arizona^s at-risk population. First 
and foremost, these efforts have corroborated 20 
years of research that points to low language profi- 
ciency as a key correlate of academic failure, and low 
self-esteem as a by-product of such failure. Pilot sites 
have demonstrated progress toward improving stu- 
dents* language skills and self-esteem. The state 
should actively promote practices that have contribut- 
ed to such progress. Promising practices include full- 
day kindergarten and reducing student-staff ratios at 
the K-3 level. At the 7-12 level, more "holistic" 
delivery systems (e.g., alternative schools) appear 
promising. In general: 
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• Advocate increased indi?idiialization of 
instruction for at-risk pupils at all grade 
levels* 

• Expand the ddivery of yocational/occup- 
ational education for older students, and the 
use of iftpplied academics in particular. 

• Promote continued development of support 
services both on-site (e.g. , counseling) as well as 
with conunuaUy social service providers (e.g.» 
Family Resource Craters). 

8« The state should develop mechanisms to assist 
local districts/schools to improve parent involve- 
ment. 

• Reinforce requirements that K-3 dis- 
tricts/schools incorporate parent outreach as a 
condition for initial or continued fundiiig. 
Virtually all K-3 personnel say that parent in- 
volvement is desirable. They also acknowledge 
that parent programs are difficult to implement, 
and that they might not have focused on parent 
services if not for the requirements of H.B. 2217 
(1988). 

• Launch a public awareness campaign to 
encourage parents to support their children's 
education* 

• Allow expenditures for food purchases 
related to school social events (e.g«, re- 
freshments) to support district/school efforts 
in garnering public support* Latitude is re- 
quired regarding what constitutes "acceptable" 
parent involvement activities. For many districts, 
efforts to attract parents to the school environ- 
ment may be most effective wh«i they involve 
non-academic activities. 

• Advocate secondary-level parent involvement 
programs. 

• Disseminate "promising practices*^ for in- 
creasing parent involvement including: work- 
shops that actively involve parents^ face-to-face 
communication (e.g., home visits), and model 
strategies used among 7-12 programs. 

9. Arizona's state university teacher training 
programs should emphasize at-risk issues. 

Two issues ate encompassed in this recommenda- 
tion. First, here needs to be a greater emphasis on 



at-risk issues for all teachers, and a wider range of 
training opportunities. Second, there needs to be 
greater focus on recruiting and training minorities to 
be teachers/administrators. 

• IVepare all students in teacher training 
programs to work with students at risk. 

• Develop a curriculum for at-risk special- 
ization. 

• Establish procedures for greater collabo- 
ration and articulation among schools and 
universities in planning and delivering pre- 
service programs. 

• Provide a wider range of pre-service train- 
ing including: teaching experience with at-risk 
populations, internships with master teachers, 
and exposure to multicultural/multilingual issues. 

• Use demonstration sites for student teaching 
and internships. 

• Review the effects of the Pre-Professional 
Skills Test (PPST), used as a requirement for 
admission into teacher tnining programs, on 
minority admissions. 

• Provide more training opportunities within 
rural and reservation communities to assist 
more local personnel in obtaining teaching and 
administrative r^'rtificate with a goal to reduce 
the "revolving door" syndrome apparent in these 
commuiJties. 

10* State and local educational agencies should 
improve in-service training with respect to at-risk 
populations. 

• Use technology for in-service training deliv- 
ery (e.g. , workshops and college courses offered 
via satellite). 

• Establish procedures for greater collabora- 
tion and articulation among schools, commu- 
nity colleges, and universities in plaiuiing and 
delivering in-service programs. 

• Use demonstration site personnel as peer 
trainers for new district/school at-risk pro- 
gram staff. 

• Extend state efforts to provide in-service 
training by offering regularly scheduled at-risk 
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conferences and/or academies, as these have 
been well-received. 

• Be a catalyst to influence local districts to 
reassess existing incentix programs for staff 
development, since some district policies regard* 
ing teacher compensation for advanced training 
are perceived as inadequate by the teaching staff. 

11. The Arizona Department of Education should 
waive annual at-risk funding reapprovals for 
current pilot sites that have dendonstrated success. 

Pending reapproval of these programs in relation 
to a revised state comprehensive plan, some dis- 
tricts/schools should be eligible for continued funding 
and should immediately be placed on an extended 
evaluation cycle (i.e., every two-thtee years). At the 
discretion of the funding agency, however, other 
continuing districts/schools should be required to 
submit comprehensive plans and remain on an annual 
evaluation cycle. 

Endnotes 



1 . The Arizoaa At-Ritk Filoi Project ii deKribed in lUI b the 
reporti: Arizona at-risk pilot project FY 1989/90 project report 
(Bteriein, Vandegrift, Htitwell, Sundler A Champigne, 1990) tnd 
Powerfid Stories, Positive Resuiu: Arizona At-Risk Project Report 
FY 1990-91 (Viodegrift, BlerietA & Oieeiie, 1991) 

1 . K-3 Student Pro(Uet were completed by teachen or other school 
itafT; 7-12 Student ProfUei were completed by itudeoti themselvee« 

2. Individual district data have been examined to determine 
patterai of "what worka;" however, a more defioitive analyua of 
individual diitricta* aucceMliil program! will be highlighted in an 
additional repoit: Promising Practices for At-Risk Youth (forthcom- 
ing in June 1992). 

3. Unlike, for example, K-3 direct formula fundi that provide 
direct funding without any itate restrictiona/requirementa. A wealth 
of anecdoul evidence it available to show tl n the $100 plua 
dollara currently being provided for each K*3 student would have 
resulted in greater outcomes if targeted toward those students. 

4. The use of at-risk tndicaton as psrt of formula weighting is 
currently being analyzed by Dr. T.S. Lyons from the Univeittty 
of Nevada at Las Vegas and Dr. K.F. Jordan from Arizona State 
University. Their findings from regression analyses show that of 
eleven at-risk indicators currently used in Texas, one indicator- 
poverty-accounted for 90 percent of the variance, while mobility 
accounted for the next l.S percent of the vanance, and LEP 
accounted for 0.4 percent (telephone interview with K.F. Jordan, 
October 1991). 
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Morrison Institute for Public Policy 



Established in 1981 through a gift from the Morrison family of Gilbert, Arizona, Morrison 
Institute for I^blic Policy is an Arizona State University (ASU) resource for public policy research, 
expertise, and insight. The Institute conducts research on public policy matters, informs policy 
makers and thr public about issues of importance to Arizona, and advises leaders on choices and 
actions. A center in the School of Public Affairs (College of Public I^ograms), Morrison Institute 
helps make ASU s resources accessible by bridging the gap between the worlds of scholarship and 
public policy. 

The Institute s primary functions are to offer a variety of services to public and private sector 
clients and to pursue its own research agenda. Morrison Institute's services include policy research 
and analysis, program evaluation, strategic planning, public policy forums, and support of citizen 
participation in public affairs. The Institute also serves ASU's administration by conducting 
research pertine^it to a variety of university affairs. 

Morrison Institute's researchers are some of Arizona s most experienced and well known policy 
analysts, llieir wide-ranging experiences in the public and privaU) sectors and in policy develop- 
ment at the local, st^ite, and national levels ensure that Morrison Institute s work is balanced and 
realistic. The Institute's interests and expertise span such areas as education, urban growth, the 
environment, human services, anc' economic development. 

ITie Institute's funding comes from grants and contracts from local, state, and federal agencies 
and private sources. StaU> appropriations to Arizona State University and endowment income 
enable the Institute? to conduct independent research and to provide some services pro bono. 
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